-- Logs begin at Thu 2022-06-16 18:01:08 UTC, end at Thu 2022-06-16 19:19:08 UTC. -- Jun 16 18:50:13.409165 dv-cinder-846172-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 16 18:50:13.420684 dv-cinder-846172-1-iscsi devstack@n-api.service[103267]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 16 18:50:13.423273 dv-cinder-846172-1-iscsi devstack@n-api.service[103267]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 16 18:50:13 2022] *** Jun 16 18:50:13.423273 dv-cinder-846172-1-iscsi devstack@n-api.service[103267]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 16 18:50:13.423273 dv-cinder-846172-1-iscsi devstack@n-api.service[103267]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 16 18:50:13.423273 dv-cinder-846172-1-iscsi devstack@n-api.service[103267]: nodename: dv-cinder-846172-1-iscsi Jun 16 18:50:13.423273 dv-cinder-846172-1-iscsi devstack@n-api.service[103267]: machine: x86_64 Jun 16 18:50:13.423273 dv-cinder-846172-1-iscsi devstack@n-api.service[103267]: clock source: unix Jun 16 18:50:13.423273 dv-cinder-846172-1-iscsi devstack@n-api.service[103267]: pcre jit disabled Jun 16 18:50:13.423273 dv-cinder-846172-1-iscsi devstack@n-api.service[103267]: detected number of CPU cores: 4 Jun 16 18:50:13.423273 dv-cinder-846172-1-iscsi devstack@n-api.service[103267]: current working directory: / Jun 16 18:50:13.423273 dv-cinder-846172-1-iscsi devstack@n-api.service[103267]: detected binary path: /usr/bin/uwsgi-core Jun 16 18:50:13.424000 dv-cinder-846172-1-iscsi devstack@n-api.service[103267]: your processes number limit is 47680 Jun 16 18:50:13.424000 dv-cinder-846172-1-iscsi devstack@n-api.service[103267]: your memory page size is 4096 bytes Jun 16 18:50:13.424000 dv-cinder-846172-1-iscsi devstack@n-api.service[103267]: detected max file descriptor number: 2048 Jun 16 18:50:13.424000 dv-cinder-846172-1-iscsi devstack@n-api.service[103267]: lock engine: pthread robust mutexes Jun 16 18:50:13.424000 dv-cinder-846172-1-iscsi devstack@n-api.service[103267]: thunder lock: enabled Jun 16 18:50:13.424000 dv-cinder-846172-1-iscsi devstack@n-api.service[103267]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 16 18:50:13.424000 dv-cinder-846172-1-iscsi devstack@n-api.service[103267]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 16 18:50:13.469330 dv-cinder-846172-1-iscsi devstack@n-api.service[103267]: Python main interpreter initialized at 0x5579c46509c0 Jun 16 18:50:13.469330 dv-cinder-846172-1-iscsi devstack@n-api.service[103267]: python threads support enabled Jun 16 18:50:13.469330 dv-cinder-846172-1-iscsi devstack@n-api.service[103267]: your server socket listen backlog is limited to 100 connections Jun 16 18:50:13.469330 dv-cinder-846172-1-iscsi devstack@n-api.service[103267]: your mercy for graceful operations on workers is 90 seconds Jun 16 18:50:13.469723 dv-cinder-846172-1-iscsi devstack@n-api.service[103267]: mapped 403077 bytes (393 KB) for 2 cores Jun 16 18:50:13.469815 dv-cinder-846172-1-iscsi devstack@n-api.service[103267]: *** Operational MODE: preforking *** Jun 16 18:50:13.470013 dv-cinder-846172-1-iscsi devstack@n-api.service[103267]: *** uWSGI is running in multiple interpreter mode *** Jun 16 18:50:13.470013 dv-cinder-846172-1-iscsi devstack@n-api.service[103267]: spawned uWSGI master process (pid: 103267) Jun 16 18:50:13.470217 dv-cinder-846172-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 16 18:50:13.471586 dv-cinder-846172-1-iscsi devstack@n-api.service[103267]: spawned uWSGI worker 1 (pid: 103268, cores: 1) Jun 16 18:50:13.471586 dv-cinder-846172-1-iscsi devstack@n-api.service[103267]: spawned uWSGI worker 2 (pid: 103269, cores: 1) Jun 16 18:50:13.471586 dv-cinder-846172-1-iscsi devstack@n-api.service[103267]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 16 18:50:14.144756 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 18:50:14.160821 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 18:50:15.353619 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 18:50:15.353619 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: from cryptography.utils import int_from_bytes Jun 16 18:50:15.354189 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 18:50:15.354189 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: from cryptography.utils import int_from_bytes Jun 16 18:50:15.360062 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 18:50:15.360062 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: from cryptography.utils import int_from_bytes Jun 16 18:50:15.360534 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 18:50:15.360534 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: from cryptography.utils import int_from_bytes Jun 16 18:50:18.007614 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 18:50:18.008179 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 18:50:18.008493 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 18:50:18.009023 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 18:50:18.009427 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 18:50:18.009828 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.010157 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.010476 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.010826 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.011159 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.011469 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.011787 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.012108 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.012435 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.012695 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.013264 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.013586 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846172-1-iscsi {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.013908 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.014209 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.014520 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.014860 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.015311 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.015631 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.015941 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.016452 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.016568 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 18:50:18.016976 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 18:50:18.017092 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.017213 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.017321 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 18:50:18.017491 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.017614 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 18:50:18.017827 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.017942 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 18:50:18.018143 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.018341 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.018539 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.018750 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.018969 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.019124 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.019344 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.019542 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.019720 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.019881 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.020066 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.020243 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.020464 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846172-1-iscsi {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.020644 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.020797 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.021019 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.021219 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.021371 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.021371 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.021721 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.021901 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.022088 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.022309 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846172-1-iscsi {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.022485 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.022659 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.022811 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.022937 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.023090 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.023299 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.023453 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.023579 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.023703 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.023826 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.024011 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.024179 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.024316 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.024450 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.024579 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.024788 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.024953 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.024953 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.025200 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.025324 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.025479 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.025605 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.025748 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.025875 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.025999 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.026133 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.026269 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.026393 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.026517 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.026669 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.026864 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.027003 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.027176 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.027304 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.027493 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.027620 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.027800 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.027937 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.028109 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.028263 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846172-1-iscsi {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.028397 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.028535 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.028668 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.028795 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.028925 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.029104 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.029242 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.029523 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.029652 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.029827 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.029954 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.030134 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.030279 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.030440 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.030589 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.030845 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.030987 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.031113 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.031261 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.031397 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.031527 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.031653 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.031778 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.031964 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.032101 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.032283 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.032421 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.032589 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.032718 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.032896 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.033024 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.033205 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.033333 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.70 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.033521 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.70 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.033664 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.033805 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.033931 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.034110 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.034239 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.034417 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.034547 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.034722 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.034862 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.034988 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.035112 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.035288 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.035426 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.035610 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.035749 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.035875 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.036000 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.036131 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.036268 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.036394 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.036550 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.036688 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.036880 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.037019 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.037180 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.037363 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.037496 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.037624 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.037749 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.037882 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.038009 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.038160 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.038296 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.038465 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.038624 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.038795 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.038935 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.039102 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.039230 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.039419 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.040113 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.040303 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.040603 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.040794 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.041032 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.041169 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.041345 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.041484 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.041652 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.041788 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.041954 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.042152 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.70 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.042290 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.042417 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.70 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.042558 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.042749 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.042875 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.043063 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.043206 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.043387 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.043522 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.043698 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.043839 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.044042 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.044186 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.044336 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.044463 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.044639 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.044769 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.044967 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.045160 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.045303 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.045430 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.045555 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.045680 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.045838 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.045986 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.046145 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.046282 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.046408 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.046540 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.046723 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.046867 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.047016 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.047142 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.047334 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.047463 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.047642 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.047772 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.047937 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.048065 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.048239 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.048377 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.048593 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.048726 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.048843 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.048955 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.049123 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.049253 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.049418 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.049546 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.049719 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.049847 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.050020 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.050148 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.050320 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.050447 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.050639 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.050768 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.050942 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.051088 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.051224 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.051351 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.051537 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.051667 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.051853 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.051997 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.052157 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.052284 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.052457 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.052583 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.052755 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.052892 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.053058 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.053194 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.053375 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.053504 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.053680 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.053823 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.053985 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.054113 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.054306 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.054435 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.054638 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.054794 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.054940 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.055074 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.056073 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.056402 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.056666 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.056815 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.056943 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.057082 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.057248 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.057378 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.057562 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.057693 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.057875 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.058004 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.058186 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.058323 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.058496 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.058646 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.058831 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.059000 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.059113 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.059275 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.059417 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.059590 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.059722 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.060008 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.060134 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.060315 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.060457 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.060621 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.060752 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.060922 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.061050 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.061243 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.061390 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.061554 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.061699 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.061858 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.061988 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.062160 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.062297 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.062464 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.062621 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.062806 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:50:18.062936 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.063143 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.063282 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.063461 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.063599 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.063772 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.063913 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.064080 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.064218 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.064389 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.064520 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.064736 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.064876 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.065022 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.065148 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.065314 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.065452 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.065631 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.065760 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.065942 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.066073 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.066249 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.066376 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.066552 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.066712 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.066884 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.067012 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.067191 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.067327 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.067503 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.067639 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.067822 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.067950 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.068134 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.068261 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.068441 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.068577 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.068754 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.068882 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.069061 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.069181 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.069369 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.069509 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.069676 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.069805 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.069979 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.070107 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.070317 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.070466 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.070644 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.070835 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.070967 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.071363 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.071596 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.071729 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.071920 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.072064 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.072250 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.072388 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.072575 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.072705 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.072889 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.073016 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.073196 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.073327 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.073504 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.073635 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.073824 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.073961 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.074159 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.074316 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.074469 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.074622 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.074816 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.074938 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.075134 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.075257 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.075445 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.075555 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.075749 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.075847 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.076053 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.076161 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.076360 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.076458 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.076663 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.076805 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.076965 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.077105 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.077276 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.077408 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.077586 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.077715 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.077895 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.078026 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.078203 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.078330 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.078508 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.078703 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.078844 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.078976 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.079139 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.079261 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.079445 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.079573 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.079749 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.079889 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.080059 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.080188 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.080362 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.080490 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.080681 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.080809 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.081005 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.081134 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.081311 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.081450 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.081611 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.081740 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.081920 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.082049 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.082223 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.082360 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.082526 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.082684 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.082854 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.082992 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.083159 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.083296 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.083458 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.083585 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.083759 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.083896 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.084059 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.084202 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.084362 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.084492 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.084661 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.084790 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.084969 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.085110 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.085272 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.085398 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.085575 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.085704 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.085875 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.086003 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.086174 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.086301 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.086542 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.087012 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.087280 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.087506 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.087642 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.087769 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.087944 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.088085 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.088262 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.088402 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.088584 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.088714 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.088896 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.089030 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.089211 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.089387 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.089525 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.089852 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.090002 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.090142 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.090269 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.090398 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.090522 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.090742 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.090875 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.091055 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.091189 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.091379 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.091509 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.091689 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.091820 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.092010 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.092149 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.092322 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.092452 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.092642 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.092779 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.092946 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.093078 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.093261 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.093406 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.093599 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.093736 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.093914 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.094050 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.094229 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.094360 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.094542 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.094702 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.094887 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.095027 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.095200 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.095338 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.095506 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.095648 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.095814 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.095949 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.096121 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.096256 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.096432 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.096571 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.096749 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.096886 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.097058 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.097188 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.097378 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.097509 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.097687 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.097816 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.098005 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.098136 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.098315 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.098446 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.098655 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.098787 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.098961 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.099090 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.099274 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.099405 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.099600 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.099730 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.099929 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.100060 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.100237 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.100368 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.100547 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.100676 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.100865 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.101074 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.101202 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.101325 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.101462 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.101596 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.101764 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.101902 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.102609 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.102744 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.102987 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.103173 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.103555 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.104305 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.104614 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.104834 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.104972 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.105101 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.105228 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.105371 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.105500 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.105625 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.105750 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.105877 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.106002 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.106136 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.106263 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.106395 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.106522 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.106671 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.106815 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.106945 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.107070 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.107196 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.107320 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.107445 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.107579 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.107706 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.107832 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.107957 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.108094 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.108220 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.108354 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.108354 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.108600 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.108726 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.108850 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.108976 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.109110 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.109244 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.109370 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.109504 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.109620 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.109757 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.109891 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.110172 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.110311 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.110479 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.110675 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.110814 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.110941 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.111136 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.111265 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.111446 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.111574 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.111758 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.111886 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.112067 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.112195 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.112373 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.112502 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.112682 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.112810 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.112992 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.113119 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.113300 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.113442 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.113612 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.113750 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.113921 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.114052 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.114230 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.114367 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.114536 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.114733 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.114872 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.115001 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.115172 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.115313 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.115482 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.115611 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.115791 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.115928 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.116092 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.116240 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.116400 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.116530 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.116714 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.116843 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.117053 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.117292 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.117436 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.117719 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.118364 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.118535 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.118854 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.118992 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.119119 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.119246 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.119359 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.119485 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.119625 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.119794 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.119924 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.120118 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.120245 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.120446 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.120589 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.120753 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.120893 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.121061 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.121190 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.121364 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.121494 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.121666 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.121798 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.121976 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.122106 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.122279 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.122416 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.122620 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.122751 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.122913 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.123055 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.123222 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.123363 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.123523 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.123654 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.123824 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.123953 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.124125 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.124266 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.124425 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.124555 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.124733 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.124870 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.125034 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.125176 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.125344 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.125474 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.125645 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.125776 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.125962 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.126102 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.126266 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.126401 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.126564 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.126713 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.126887 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.127025 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.127187 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.127513 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.127649 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.127819 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.127961 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.128182 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.128365 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.128498 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.128637 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.128803 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.129015 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.129145 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.129270 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.129394 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.129509 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.129769 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.129910 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.130036 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.130161 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.130301 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.130521 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.130759 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.130887 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.131029 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.131166 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.131293 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.131419 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.131543 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.131761 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.131901 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.132071 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.132195 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.132351 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.132488 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.132657 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.132793 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.132955 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.133071 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.133285 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.133419 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.133647 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.133785 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.134031 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.134171 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.134341 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.134539 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.134748 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.134943 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.135107 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.135239 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.135365 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.135501 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.135629 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.135758 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.135883 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.136008 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.136134 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.136270 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.136405 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.136532 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.136712 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.136842 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.137013 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.137156 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.137314 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.137444 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.137612 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.137742 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.138181 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.138323 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.138489 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.138672 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.138800 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.138990 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.139135 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.139302 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.139433 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.139612 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.139742 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.139957 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.140096 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.140225 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.140351 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.140543 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.140672 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.140847 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.140986 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.141152 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.141288 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.141459 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.141594 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.141774 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.141910 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.142076 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.142207 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.142384 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.142517 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.142713 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.142853 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.143016 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.143138 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.143318 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.143455 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.143622 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.143754 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.143921 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.144050 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.144205 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.144333 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.144504 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.144636 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.144803 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.144943 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.145104 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.145234 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.145421 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.145560 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.145726 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.145856 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.146029 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.146165 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.146327 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.146468 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.146636 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.146766 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.146956 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.147098 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.147263 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.147393 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.147568 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.147699 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.147879 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.148023 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.148192 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.148321 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.148510 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.148645 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.148818 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.149540 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.149672 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.149798 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.149968 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.150143 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.150285 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.150415 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.150597 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.150754 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.150885 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.151068 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.151210 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.151381 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.151542 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.151671 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.151888 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.152018 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.152242 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.152374 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.152627 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.152770 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.152898 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.153132 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.153260 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.153387 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.153513 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.153639 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.153786 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.153926 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.154094 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.154224 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.154432 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.154647 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.154828 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.154987 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.155120 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.155280 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.155454 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.155583 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.155717 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.155928 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.156058 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.156186 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.156312 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.156437 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.156626 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.156770 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.156934 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.157072 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.157241 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.157371 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.157551 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.157691 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.157897 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.158026 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.158201 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.158329 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.158501 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.158659 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.158847 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.159019 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.159148 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.159275 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.159442 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.159573 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.159751 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.159873 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.160052 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.160181 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.160365 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.160490 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.160669 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.160798 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.161009 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.161137 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.161334 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.161523 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.161659 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.161795 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.161952 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.162092 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.162261 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.162390 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.162618 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.162763 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.162899 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.163035 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.163200 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.163322 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.163503 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.163640 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.163827 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.163965 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.164154 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.164283 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.164461 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.165251 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.165465 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.165631 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.165809 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.166014 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.166240 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.166389 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.166526 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.166692 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.166821 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.166955 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.167082 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.167208 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.167344 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.167472 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.167597 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.167731 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.167860 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.168041 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.168179 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.168359 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.168503 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.168686 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.168824 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.169058 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.169197 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.169358 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.169493 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.169731 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.169859 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.170073 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.170209 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.170380 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.170510 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.170722 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.170855 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.171040 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.171171 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.171360 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.171489 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.171659 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.171788 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.171968 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.172131 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.172269 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.172583 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.172711 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.172900 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.173046 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.173208 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.173338 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.173518 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.173647 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.173818 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.173950 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.174137 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.174267 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.174454 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.174608 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.174790 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.174931 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.175099 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.175226 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.175505 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.175645 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.175826 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.175958 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.176134 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.176272 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.176453 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.176583 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.176775 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.176913 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.177079 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.177218 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.177366 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.177513 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.177675 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.177805 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.177978 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.178144 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.178275 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.178455 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.178607 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.178789 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.178922 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.179117 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.179256 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.179425 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.179570 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.179776 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.179907 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.180076 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.180304 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.180453 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.180581 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.180720 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.180974 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.181114 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.181320 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.181449 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.181719 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.181916 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.182049 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.182204 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.182406 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.182552 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.182766 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.182900 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.183028 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.183154 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.183280 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.183420 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.183596 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.183729 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.183909 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.184037 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.184243 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.184374 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.184588 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.184717 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.184891 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.185031 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.185208 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.185335 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.185516 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.185648 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.185839 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.185978 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.186147 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.186285 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.186465 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.186632 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.186814 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.186945 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.187127 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.187269 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.187443 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.187573 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.187766 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.187896 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.188068 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.188209 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.188372 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.188553 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.188685 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.188812 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.188969 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.189114 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.189270 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.189401 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.189577 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.189709 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.189883 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.190023 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.190182 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.190322 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.190481 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.190661 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.190812 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.191095 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.191225 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.191398 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.191526 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.191714 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.191854 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.192019 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.192149 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.192320 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.192458 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.192622 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.192790 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.192929 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.193106 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.193235 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.193434 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.193573 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.193751 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.193890 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.194078 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.194222 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.194404 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.194544 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.194725 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.194863 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.195052 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.195188 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.195366 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.195505 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.195672 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.195869 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.196105 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.196241 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.196510 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.196686 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.196814 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.196939 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.197125 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.197254 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.197439 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.197614 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.197748 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.197916 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.198046 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.198288 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.198427 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.198649 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.198782 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.198971 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.199097 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.199309 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.199516 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.199646 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.199846 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.199974 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.200159 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.200283 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.200471 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.200600 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.200781 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.200951 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.201079 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.201270 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.201408 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.201581 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.201709 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.201910 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.202098 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.202236 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.202484 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.202627 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.202830 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.202975 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.203133 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.203270 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.203441 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.203578 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.203748 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.203883 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.204089 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.204219 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.204369 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.204499 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.204681 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.204812 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.204989 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.205121 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.205296 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.205436 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.205603 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.205725 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.205948 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.206080 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.206250 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.206379 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.206563 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.206769 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.206897 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.207031 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.207195 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.207325 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.207507 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.207651 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.207818 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.207948 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.208129 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.208259 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.208441 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.208593 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.208752 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.208882 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.209059 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.209189 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.209377 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.209508 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.209689 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.209820 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.210012 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.210140 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.210369 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.210517 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.210672 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.210815 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.210984 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.211189 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.211953 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.212091 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.212217 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.212343 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.212725 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.212864 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.213060 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.213235 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.213405 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.213534 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.213722 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.213854 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.214039 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.214178 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.214352 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.214480 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.214691 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.214837 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.215006 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.215134 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.215308 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.215436 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.215611 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.215751 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.215920 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.216050 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.216228 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.216366 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.216531 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.216671 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.216851 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.216982 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.217158 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.217288 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.217460 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.217592 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.217780 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.217911 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.218089 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.218220 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.218527 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.219764 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.219897 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.220042 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.220162 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.220302 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.220430 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.220557 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.220682 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.220797 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.220922 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.221057 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.221186 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.221326 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.221454 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.221588 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.221715 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.221850 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.221989 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.222118 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.222245 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.222372 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.222506 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.222681 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.222823 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.222960 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.223087 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.223214 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.223354 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.223484 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.223619 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.223746 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.223871 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.224000 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.224136 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.224272 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.224400 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.224534 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.224662 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.224796 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.224932 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.225061 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.225217 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.225348 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.225523 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.225663 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.225838 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.225976 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.226143 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.226278 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.226448 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.226611 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.226779 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.226910 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.227675 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.227819 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.228052 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.228184 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.228362 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.228501 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.228671 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.228802 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.228986 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.229131 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.229300 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.229444 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.229600 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.229728 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.229914 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.230045 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.230225 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.230362 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.230534 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.230718 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.230881 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.231023 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.231182 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.231311 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.231499 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.231719 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.231863 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.232070 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.232200 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.232389 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.232527 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.232704 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.232843 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.233028 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.233157 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.233347 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.233485 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.233658 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.233878 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.234012 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.234210 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.234341 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.234532 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.234705 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.234891 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.234986 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.235218 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.235307 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.235523 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.235625 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.235829 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.235933 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.236130 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.236223 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.236438 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.236526 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.236744 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.236831 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.237049 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.237143 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.237352 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.237438 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.237658 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.237746 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.237967 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.238063 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.238272 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.238367 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.238593 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.238695 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.238908 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.239005 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.239213 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.239301 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.239516 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.239601 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.239820 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.239919 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.240124 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.240210 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.240431 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.240518 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.240734 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.240840 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.241046 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.241144 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.241350 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.241445 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.241663 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.241832 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.241968 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.242064 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.242278 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.242365 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.242597 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.242798 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.242999 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.243130 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.243410 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.243681 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.243843 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.244021 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.244151 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.244351 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.244443 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.244655 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.244759 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.244958 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.245063 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.245340 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.245425 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.245656 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.245754 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.245979 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.246065 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.246303 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.246415 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.246630 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.246917 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.247015 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.247255 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.247353 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.247566 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.247664 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.247883 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.247970 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.248190 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.248278 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.248512 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.248610 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.248824 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.248926 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.249136 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.249224 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.249468 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.249566 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.249776 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.249862 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.250079 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.250175 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.250380 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.250477 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.250710 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.250814 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.251026 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.251135 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.251329 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.251424 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.251628 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.251716 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.251927 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.252021 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.252233 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.252323 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.252535 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.252624 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.252840 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.252935 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.253148 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.253263 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.253451 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.253549 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.253757 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.253864 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.254056 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.254151 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.254357 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.254462 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.254681 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.254848 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.255011 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.255154 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.255293 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.255432 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.255587 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.255728 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.255869 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.256009 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.256148 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.256317 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.256477 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.256627 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.256767 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.256920 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.257060 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.257200 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.257352 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.257494 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.257633 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.257774 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.257921 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.258177 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.258291 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.258677 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.258788 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.259034 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.259134 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.259381 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.259472 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.259692 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.259778 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.260011 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.260102 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.260328 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.260426 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.260640 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.260735 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.260952 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.261109 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.261304 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.261493 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.261730 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.261902 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.262030 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.262131 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.262301 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.262391 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.262629 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.262734 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.263225 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.263367 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.263516 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.263604 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.263840 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.263927 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.264152 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.264251 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.264453 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.264597 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.264773 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.264860 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.265086 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.265184 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.265390 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.265484 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.265702 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.265790 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.266008 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.266094 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.266315 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.266427 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.266642 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.266740 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.266953 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.267048 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.267263 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.267367 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.267565 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.267658 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.267871 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.267973 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.268182 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.268275 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.268487 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.268597 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.268793 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.268954 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.269105 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.269305 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.269451 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.269602 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.269745 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.269884 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.270031 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.270172 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.270319 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.270471 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.270635 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.270793 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.270936 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.271075 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.271265 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.271494 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.271649 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.271799 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.271941 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.272169 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.272328 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.272471 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.272471 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103269) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 18:50:18.272738 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.272885 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.273143 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.273487 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.273849 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.274772 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.275084 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.275422 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.275737 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.276051 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.276365 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.276700 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.277034 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.277390 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.277741 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.278071 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.278379 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.278801 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.279135 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.279459 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.279779 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.280093 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.280446 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.280763 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.281094 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.281413 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.281728 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.282042 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.282359 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.282699 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.283032 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.283361 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.283675 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.284003 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.284331 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.284680 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.284996 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.285346 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.285699 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.286019 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.286335 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.286667 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:50:18.286915 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 18:50:18.336182 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: INFO dbcounter [None req-0cb421ba-73bf-42d0-9081-5a3fe624faf7 None None] Registered counter for database nova_api Jun 16 18:50:18.350753 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: INFO dbcounter [None req-302899a7-e63b-4af9-b27a-609a3ee6d4dc None None] Registered counter for database nova_api Jun 16 18:50:18.357753 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG oslo_db.sqlalchemy.engines [None req-0cb421ba-73bf-42d0-9081-5a3fe624faf7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103269) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 18:50:18.364314 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG dbcounter [-] [103269] Writer thread running {{(pid=103269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 18:50:18.372022 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG oslo_db.sqlalchemy.engines [None req-302899a7-e63b-4af9-b27a-609a3ee6d4dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103268) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 18:50:18.378643 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG dbcounter [-] [103268] Writer thread running {{(pid=103268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 18:50:18.423713 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.context [None req-0cb421ba-73bf-42d0-9081-5a3fe624faf7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1c329222-bcc4-442b-afcb-bc828e5eed9e(cell1) {{(pid=103269) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 18:50:18.427841 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG oslo_concurrency.lockutils [None req-0cb421ba-73bf-42d0-9081-5a3fe624faf7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:18.429406 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG oslo_concurrency.lockutils [None req-0cb421ba-73bf-42d0-9081-5a3fe624faf7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:18.430302 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG oslo_concurrency.lockutils [None req-0cb421ba-73bf-42d0-9081-5a3fe624faf7 None None] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:18.432558 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG oslo_concurrency.lockutils [None req-0cb421ba-73bf-42d0-9081-5a3fe624faf7 None None] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:18.434945 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: INFO dbcounter [None req-0cb421ba-73bf-42d0-9081-5a3fe624faf7 None None] Registered counter for database nova_cell0 Jun 16 18:50:18.438406 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.context [None req-302899a7-e63b-4af9-b27a-609a3ee6d4dc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1c329222-bcc4-442b-afcb-bc828e5eed9e(cell1) {{(pid=103268) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 18:50:18.438675 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: INFO dbcounter [None req-0cb421ba-73bf-42d0-9081-5a3fe624faf7 None None] Registered counter for database nova_cell1 Jun 16 18:50:18.442561 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG oslo_concurrency.lockutils [None req-302899a7-e63b-4af9-b27a-609a3ee6d4dc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:18.448846 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG oslo_concurrency.lockutils [None req-302899a7-e63b-4af9-b27a-609a3ee6d4dc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:18.448846 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG oslo_concurrency.lockutils [None req-302899a7-e63b-4af9-b27a-609a3ee6d4dc None None] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:50:18.449163 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG oslo_db.sqlalchemy.engines [None req-0cb421ba-73bf-42d0-9081-5a3fe624faf7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103269) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 18:50:18.449265 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG oslo_concurrency.lockutils [None req-302899a7-e63b-4af9-b27a-609a3ee6d4dc None None] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:50:18.449360 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG oslo_db.sqlalchemy.engines [None req-0cb421ba-73bf-42d0-9081-5a3fe624faf7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103269) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 18:50:18.449488 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: INFO dbcounter [None req-302899a7-e63b-4af9-b27a-609a3ee6d4dc None None] Registered counter for database nova_cell0 Jun 16 18:50:18.453610 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: INFO dbcounter [None req-302899a7-e63b-4af9-b27a-609a3ee6d4dc None None] Registered counter for database nova_cell1 Jun 16 18:50:18.456277 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG dbcounter [-] [103269] Writer thread running {{(pid=103269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 18:50:18.457553 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG dbcounter [-] [103269] Writer thread running {{(pid=103269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 18:50:18.460617 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG oslo_db.sqlalchemy.engines [None req-302899a7-e63b-4af9-b27a-609a3ee6d4dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103268) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 18:50:18.463138 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG oslo_db.sqlalchemy.engines [None req-302899a7-e63b-4af9-b27a-609a3ee6d4dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103268) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 18:50:18.469425 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG dbcounter [-] [103268] Writer thread running {{(pid=103268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 18:50:18.471519 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG dbcounter [-] [103268] Writer thread running {{(pid=103268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 18:50:18.607907 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: INFO dbcounter [None req-0cb421ba-73bf-42d0-9081-5a3fe624faf7 None None] Registered counter for database nova_cell0 Jun 16 18:50:18.614633 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG oslo_db.sqlalchemy.engines [None req-0cb421ba-73bf-42d0-9081-5a3fe624faf7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103269) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 18:50:18.619503 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG dbcounter [-] [103269] Writer thread running {{(pid=103269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 18:50:18.621656 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: INFO dbcounter [None req-302899a7-e63b-4af9-b27a-609a3ee6d4dc None None] Registered counter for database nova_cell0 Jun 16 18:50:18.629256 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG oslo_db.sqlalchemy.engines [None req-302899a7-e63b-4af9-b27a-609a3ee6d4dc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103268) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 18:50:18.634862 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG dbcounter [-] [103268] Writer thread running {{(pid=103268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 18:50:18.963492 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: WARNING keystonemiddleware.auth_token [None req-0cb421ba-73bf-42d0-9081-5a3fe624faf7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 18:50:18.970745 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: WARNING keystonemiddleware.auth_token [None req-0cb421ba-73bf-42d0-9081-5a3fe624faf7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 18:50:18.972195 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: WARNING keystonemiddleware.auth_token [None req-302899a7-e63b-4af9-b27a-609a3ee6d4dc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 18:50:18.980294 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: WARNING keystonemiddleware.auth_token [None req-302899a7-e63b-4af9-b27a-609a3ee6d4dc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 18:50:19.317371 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: WARNING keystonemiddleware.auth_token [None req-0cb421ba-73bf-42d0-9081-5a3fe624faf7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 18:50:19.324116 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: WARNING keystonemiddleware.auth_token [None req-0cb421ba-73bf-42d0-9081-5a3fe624faf7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 18:50:19.324282 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: WARNING keystonemiddleware.auth_token [None req-302899a7-e63b-4af9-b27a-609a3ee6d4dc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 18:50:19.329398 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5579c46509c0 pid: 103269 (default app) Jun 16 18:50:19.330095 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: WARNING keystonemiddleware.auth_token [None req-302899a7-e63b-4af9-b27a-609a3ee6d4dc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 18:50:19.331486 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-0cb421ba-73bf-42d0-9081-5a3fe624faf7 None None] Calling method '>' {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:50:19.332680 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-0cb421ba-73bf-42d0-9081-5a3fe624faf7 None None] 10.222.0.70 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001769 Jun 16 18:50:19.333087 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 1/1] 10.222.0.70 () {50 vars in 788 bytes} [Thu Jun 16 18:50:19 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:50:19.335538 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5579c46509c0 pid: 103268 (default app) Jun 16 18:51:40.775498 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-0cb421ba-73bf-42d0-9081-5a3fe624faf7 None None] Calling method '>' {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:40.776530 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-0cb421ba-73bf-42d0-9081-5a3fe624faf7 None None] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001690 Jun 16 18:51:40.776940 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 2/2] 10.222.0.70 () {54 vars in 930 bytes} [Thu Jun 16 18:51:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:51:40.789685 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG dbcounter [-] [103268] Writing DB stats nova_api:SELECT=3 {{(pid=103268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:40.791378 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG dbcounter [-] [103268] Writing DB stats nova_cell0:SELECT=3 {{(pid=103268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:40.792177 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG dbcounter [-] [103268] Writing DB stats nova_cell1:SELECT=3 {{(pid=103268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:40.793242 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG dbcounter [-] [103268] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:41.309232 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-cf58823f-dd74-4168-a5d9-3b77ee62b7d5 admin admin] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:41.340152 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-cf58823f-dd74-4168-a5d9-3b77ee62b7d5 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.555773 Jun 16 18:51:41.341271 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 1/3] 10.222.0.70 () {60 vars in 1291 bytes} [Thu Jun 16 18:51:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:43.615690 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-0cb421ba-73bf-42d0-9081-5a3fe624faf7 None None] Calling method '>' {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:43.617255 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-0cb421ba-73bf-42d0-9081-5a3fe624faf7 None None] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002005 Jun 16 18:51:43.617648 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 3/4] 10.222.0.70 () {54 vars in 930 bytes} [Thu Jun 16 18:51:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:51:43.689343 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-285ecc2b-c42a-4b49-87f2-b104e49e8141 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "rxtx_factor": 1.0, "ram": 256, "disk": 1, "swap": 0, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:51:43.709305 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:51:43.709305 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: warnings.warn(msg) Jun 16 18:51:43.749303 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-285ecc2b-c42a-4b49-87f2-b104e49e8141 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.124645 Jun 16 18:51:43.750082 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 2/5] 10.222.0.70 () {64 vars in 1282 bytes} [Thu Jun 16 18:51:43 2022] POST /compute/v2.1/flavors => generated 407 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 18:51:43.764413 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG dbcounter [-] [103269] Writing DB stats nova_api:SELECT=3 {{(pid=103269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:43.765683 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG dbcounter [-] [103269] Writing DB stats nova_cell0:SELECT=3 {{(pid=103269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:43.766425 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG dbcounter [-] [103269] Writing DB stats nova_cell1:SELECT=3 {{(pid=103269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:43.767978 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG dbcounter [-] [103269] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:51:43.998154 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-1bcb90d4-a1b9-4232-889d-3c9c6cb38671 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:51:44.001209 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:51:44.001209 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: warnings.warn(msg) Jun 16 18:51:44.072373 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-1bcb90d4-a1b9-4232-889d-3c9c6cb38671 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.313962 Jun 16 18:51:44.080439 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 4/6] 10.222.0.70 () {64 vars in 1335 bytes} [Thu Jun 16 18:51:43 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:46.383413 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-285ecc2b-c42a-4b49-87f2-b104e49e8141 admin admin] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:46.384416 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-285ecc2b-c42a-4b49-87f2-b104e49e8141 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001636 Jun 16 18:51:46.385447 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 3/7] 10.222.0.70 () {54 vars in 930 bytes} [Thu Jun 16 18:51:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:51:46.508237 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-d346f991-9c7b-48f2-ab43-63133662326c admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "ram": 512, "name": "ds512M", "disk": 5, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0}} {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:51:46.529103 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:51:46.529103 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: warnings.warn(msg) Jun 16 18:51:46.549104 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-d346f991-9c7b-48f2-ab43-63133662326c admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.156674 Jun 16 18:51:46.549655 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 5/8] 10.222.0.70 () {64 vars in 1282 bytes} [Thu Jun 16 18:51:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:51:46.561948 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-c86dee2e-60e2-45f3-bcd4-7ca4cc6f1cc3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:51:46.563625 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:51:46.563625 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: warnings.warn(msg) Jun 16 18:51:46.595400 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-c86dee2e-60e2-45f3-bcd4-7ca4cc6f1cc3 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037371 Jun 16 18:51:46.595988 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 4/9] 10.222.0.70 () {64 vars in 1335 bytes} [Thu Jun 16 18:51:46 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:51:48.817282 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-d346f991-9c7b-48f2-ab43-63133662326c admin admin] Calling method '>' {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:48.818303 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-d346f991-9c7b-48f2-ab43-63133662326c admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Jun 16 18:51:48.819002 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 6/10] 10.222.0.70 () {54 vars in 930 bytes} [Thu Jun 16 18:51:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:51:48.880648 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-35c264e3-0b11-4160-8517-813b8d7e2e7f admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "disk": 10, "os-flavor-access:is_public": true, "vcpus": 1, "id": "d2", "rxtx_factor": 1.0, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:51:48.901122 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-35c264e3-0b11-4160-8517-813b8d7e2e7f admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076058 Jun 16 18:51:48.901774 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 5/11] 10.222.0.70 () {64 vars in 1282 bytes} [Thu Jun 16 18:51:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:51:48.913786 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-fb9536bd-16a2-43ca-b769-b66cfb18cc3e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:51:48.939084 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-fb9536bd-16a2-43ca-b769-b66cfb18cc3e admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029086 Jun 16 18:51:48.939794 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 7/12] 10.222.0.70 () {64 vars in 1335 bytes} [Thu Jun 16 18:51:48 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:51:51.167177 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-35c264e3-0b11-4160-8517-813b8d7e2e7f admin admin] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:51.168194 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-35c264e3-0b11-4160-8517-813b8d7e2e7f admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002078 Jun 16 18:51:51.168597 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 6/13] 10.222.0.70 () {54 vars in 930 bytes} [Thu Jun 16 18:51:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:51:51.232544 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-4fc82bab-c2d0-4d56-b385-9ec1ff27a7fd admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "os-flavor-access:is_public": true, "id": "d3", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds2G", "ram": 2048, "disk": 10}} {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:51:51.252496 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-4fc82bab-c2d0-4d56-b385-9ec1ff27a7fd admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077929 Jun 16 18:51:51.253056 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 8/14] 10.222.0.70 () {64 vars in 1282 bytes} [Thu Jun 16 18:51:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 18:51:51.265901 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-3f1aabc9-edff-4331-baf1-507358246f80 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:51:51.290985 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-3f1aabc9-edff-4331-baf1-507358246f80 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028844 Jun 16 18:51:51.291660 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 7/15] 10.222.0.70 () {64 vars in 1335 bytes} [Thu Jun 16 18:51:51 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:53.683163 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-4fc82bab-c2d0-4d56-b385-9ec1ff27a7fd admin admin] Calling method '>' {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:53.685161 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-4fc82bab-c2d0-4d56-b385-9ec1ff27a7fd admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002428 Jun 16 18:51:53.685900 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 9/16] 10.222.0.70 () {54 vars in 930 bytes} [Thu Jun 16 18:51:53 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:51:53.751888 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-457a5cc5-be5e-424d-83ca-702b89a0c7d1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 20, "swap": 0, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "vcpus": 4, "ram": 4096}} {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:51:53.777602 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-457a5cc5-be5e-424d-83ca-702b89a0c7d1 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.085115 Jun 16 18:51:53.788054 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 8/17] 10.222.0.70 () {64 vars in 1282 bytes} [Thu Jun 16 18:51:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:51:53.794563 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-0150b715-2a64-47fd-b795-da5cdadf81a3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:51:53.831828 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-0150b715-2a64-47fd-b795-da5cdadf81a3 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042128 Jun 16 18:51:53.832796 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 10/18] 10.222.0.70 () {64 vars in 1335 bytes} [Thu Jun 16 18:51:53 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:51:56.122459 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-457a5cc5-be5e-424d-83ca-702b89a0c7d1 admin admin] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:56.123429 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-457a5cc5-be5e-424d-83ca-702b89a0c7d1 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Jun 16 18:51:56.126799 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 9/19] 10.222.0.70 () {54 vars in 930 bytes} [Thu Jun 16 18:51:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:51:56.191199 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-47b5f338-ce4e-44f9-9b77-9ffeaca35aca admin admin] Calling method '>' {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:56.220319 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-47b5f338-ce4e-44f9-9b77-9ffeaca35aca admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.089657 Jun 16 18:51:56.221218 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 11/20] 10.222.0.70 () {60 vars in 1291 bytes} [Thu Jun 16 18:51:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:51:58.721156 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-457a5cc5-be5e-424d-83ca-702b89a0c7d1 admin admin] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:51:58.722172 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-457a5cc5-be5e-424d-83ca-702b89a0c7d1 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Jun 16 18:51:58.722749 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 10/21] 10.222.0.70 () {54 vars in 930 bytes} [Thu Jun 16 18:51:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:51:58.788788 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-e4686abc-7dd7-41b8-b0e3-91a5cbc41f5e admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 1, "rxtx_factor": 1.0, "name": "m1.tiny", "ram": 512, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:51:58.808374 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-e4686abc-7dd7-41b8-b0e3-91a5cbc41f5e admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.079409 Jun 16 18:51:58.808936 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 12/22] 10.222.0.70 () {64 vars in 1282 bytes} [Thu Jun 16 18:51:58 2022] POST /compute/v2.1/flavors => generated 402 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 18:51:58.821082 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-f3df6b52-7a08-41ec-82de-433cc1abe04a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:51:58.845381 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-f3df6b52-7a08-41ec-82de-433cc1abe04a admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027925 Jun 16 18:51:58.845969 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 11/23] 10.222.0.70 () {64 vars in 1332 bytes} [Thu Jun 16 18:51:58 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:52:01.171581 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-e4686abc-7dd7-41b8-b0e3-91a5cbc41f5e admin admin] Calling method '>' {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:01.173024 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-e4686abc-7dd7-41b8-b0e3-91a5cbc41f5e admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002021 Jun 16 18:52:01.173514 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 13/24] 10.222.0.70 () {54 vars in 930 bytes} [Thu Jun 16 18:52:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:52:01.246977 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-694613ff-1302-4769-91e5-04b68d5d9c8c admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "rxtx_factor": 1.0, "vcpus": 1, "ram": 2048, "name": "m1.small", "os-flavor-access:is_public": true, "swap": 0, "disk": 20}} {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:52:01.265299 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-694613ff-1302-4769-91e5-04b68d5d9c8c admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.083809 Jun 16 18:52:01.266166 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 12/25] 10.222.0.70 () {64 vars in 1282 bytes} [Thu Jun 16 18:52:01 2022] POST /compute/v2.1/flavors => generated 405 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:52:01.280685 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-1eba1051-3f2f-4d09-aef1-731b54e5142c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:52:01.305248 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-1eba1051-3f2f-4d09-aef1-731b54e5142c admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028451 Jun 16 18:52:01.305789 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 14/26] 10.222.0.70 () {64 vars in 1332 bytes} [Thu Jun 16 18:52:01 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:03.527176 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-694613ff-1302-4769-91e5-04b68d5d9c8c admin admin] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:03.528575 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-694613ff-1302-4769-91e5-04b68d5d9c8c admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Jun 16 18:52:03.528575 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 13/27] 10.222.0.70 () {54 vars in 930 bytes} [Thu Jun 16 18:52:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:52:03.599411 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-70e60bd1-cf44-4568-accc-5583fc4f3ffd admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "vcpus": 2, "disk": 40, "swap": 0, "name": "m1.medium", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 4096}} {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:52:03.618460 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-70e60bd1-cf44-4568-accc-5583fc4f3ffd admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.083913 Jun 16 18:52:03.619047 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 15/28] 10.222.0.70 () {64 vars in 1282 bytes} [Thu Jun 16 18:52:03 2022] POST /compute/v2.1/flavors => generated 406 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:52:03.631157 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-b43c77c3-5fa5-463e-8086-f1f54850ee1c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:52:03.656714 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-b43c77c3-5fa5-463e-8086-f1f54850ee1c admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029277 Jun 16 18:52:03.657305 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 14/29] 10.222.0.70 () {64 vars in 1332 bytes} [Thu Jun 16 18:52:03 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:52:05.861790 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-70e60bd1-cf44-4568-accc-5583fc4f3ffd admin admin] Calling method '>' {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:05.863139 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-70e60bd1-cf44-4568-accc-5583fc4f3ffd admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Jun 16 18:52:05.863483 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 16/30] 10.222.0.70 () {54 vars in 930 bytes} [Thu Jun 16 18:52:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:52:05.925155 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-9732f29b-af98-47b6-be2f-252abcd122cb admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "name": "m1.large", "rxtx_factor": 1.0, "id": "4", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 4, "disk": 80}} {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:52:05.946469 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-9732f29b-af98-47b6-be2f-252abcd122cb admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.077101 Jun 16 18:52:05.947281 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 15/31] 10.222.0.70 () {64 vars in 1282 bytes} [Thu Jun 16 18:52:05 2022] POST /compute/v2.1/flavors => generated 405 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:52:05.959389 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-ba92ea1e-d7c0-4231-9469-19c03925d706 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:52:05.985206 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-ba92ea1e-d7c0-4231-9469-19c03925d706 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029617 Jun 16 18:52:05.985892 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 17/32] 10.222.0.70 () {64 vars in 1332 bytes} [Thu Jun 16 18:52:05 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:08.254531 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-9732f29b-af98-47b6-be2f-252abcd122cb admin admin] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:08.256215 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-9732f29b-af98-47b6-be2f-252abcd122cb admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002131 Jun 16 18:52:08.256772 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 16/33] 10.222.0.70 () {54 vars in 930 bytes} [Thu Jun 16 18:52:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:52:08.321939 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-2a3efced-dc9b-48d8-ba67-75d7db8c3343 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "id": "5", "swap": 0, "rxtx_factor": 1.0, "ram": 16384, "vcpus": 8, "os-flavor-access:is_public": true}} {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:52:08.342074 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-2a3efced-dc9b-48d8-ba67-75d7db8c3343 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.079275 Jun 16 18:52:08.342679 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 18/34] 10.222.0.70 () {64 vars in 1282 bytes} [Thu Jun 16 18:52:08 2022] POST /compute/v2.1/flavors => generated 408 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:52:08.355919 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-0dcecb12-7e8a-4443-83c5-66ef27ed3f6d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:52:08.381753 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-0dcecb12-7e8a-4443-83c5-66ef27ed3f6d admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030790 Jun 16 18:52:08.382332 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 17/35] 10.222.0.70 () {64 vars in 1332 bytes} [Thu Jun 16 18:52:08 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:52:33.818892 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-2a3efced-dc9b-48d8-ba67-75d7db8c3343 admin admin] Calling method '>' {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:33.819903 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-2a3efced-dc9b-48d8-ba67-75d7db8c3343 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Jun 16 18:52:33.820302 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 19/36] 10.222.0.70 () {54 vars in 930 bytes} [Thu Jun 16 18:52:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:52:33.832038 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG dbcounter [-] [103268] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:33.881671 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-b3861ada-0914-47a1-ba7b-d7f1b708c7bb admin admin] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:33.899672 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-b3861ada-0914-47a1-ba7b-d7f1b708c7bb admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.072161 Jun 16 18:52:33.900223 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 18/37] 10.222.0.70 () {60 vars in 1291 bytes} [Thu Jun 16 18:52:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:52:34.931912 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-2a3efced-dc9b-48d8-ba67-75d7db8c3343 admin admin] Calling method '>' {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:34.933552 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-2a3efced-dc9b-48d8-ba67-75d7db8c3343 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002074 Jun 16 18:52:34.934106 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 20/38] 10.222.0.70 () {56 vars in 1074 bytes} [Thu Jun 16 18:52:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:52:35.139110 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-a2772e20-57fb-4af5-858e-2be42560e7ed admin admin] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:35.145117 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.wsgi [None req-a2772e20-57fb-4af5-858e-2be42560e7ed admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 16 18:52:35.148499 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-a2772e20-57fb-4af5-858e-2be42560e7ed admin admin] Request method failure captured: Jun 16 18:52:35.148499 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 16 18:52:35.148499 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: Accept: application/json Jun 16 18:52:35.148499 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: Accept-Encoding: gzip, deflate Jun 16 18:52:35.148499 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: Connection: keep-alive Jun 16 18:52:35.148499 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: Content-Length: 0 Jun 16 18:52:35.148499 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: Host: 10.222.0.70 Jun 16 18:52:35.148499 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: Openstack-Api-Version: compute 2.90 Jun 16 18:52:35.148499 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: Openstack-System-Scope: None Jun 16 18:52:35.148499 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: User-Agent: python-novaclient Jun 16 18:52:35.148499 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: X-Auth-Token: gAAAAABiq3vyFlkUJWlCV0mJ6rywCWxGzEm-v2XNMMrh29utVyV9XlIyreh8IYlaKNYUdIQTV13baXTyHoQITsY3ibXWwUKmHEGCdipieqRKk3iQZa4VIlkFjlb5dlZwAYd4S0NfJIIw4-mJ0OA8AjUxnOUtpmRkip_YqTOfrsRdRmO_3VA5Td4 Jun 16 18:52:35.148499 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: X-Domain-Id: None Jun 16 18:52:35.148499 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: X-Domain-Name: None Jun 16 18:52:35.148499 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: X-Identity-Status: Confirmed Jun 16 18:52:35.148499 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: X-Is-Admin-Project: True Jun 16 18:52:35.148499 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 18:52:35.148499 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: X-Project-Domain-Id: default Jun 16 18:52:35.148499 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: X-Project-Domain-Name: Default Jun 16 18:52:35.148499 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: X-Project-Id: 417f1f7349214e82b739864de0303f59 Jun 16 18:52:35.148499 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: X-Project-Name: admin Jun 16 18:52:35.148499 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: X-Role: member,reader,admin Jun 16 18:52:35.148499 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: X-Roles: member,reader,admin Jun 16 18:52:35.150215 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/417f1f7349214e82b739864de0303f59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_417f1f7349214e82b739864de0303f59", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/417f1f7349214e82b739864de0303f59"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/417f1f7349214e82b739864de0303f59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 16 18:52:35.150215 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: X-Tenant: admin Jun 16 18:52:35.150215 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: X-Tenant-Id: 417f1f7349214e82b739864de0303f59 Jun 16 18:52:35.150215 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: X-Tenant-Name: admin Jun 16 18:52:35.150215 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: X-User: admin Jun 16 18:52:35.150215 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: X-User-Domain-Id: default Jun 16 18:52:35.150215 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: X-User-Domain-Name: Default Jun 16 18:52:35.150215 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: X-User-Id: 7e2576df31cd4791832f5441b6f98ba5 Jun 16 18:52:35.150215 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: X-User-Name: admin Jun 16 18:52:35.150215 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: method: > Jun 16 18:52:35.150215 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: exception: Flavor 42 could not be found. Jun 16 18:52:35.150215 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: action_args: {'id': '42'} Jun 16 18:52:35.150215 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:52:35.150215 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:52:35.151725 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 18:52:35.151725 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 18:52:35.151725 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 18:52:35.151725 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 18:52:35.151725 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 18:52:35.151725 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 18:52:35.151725 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 18:52:35.151725 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 18:52:35.151725 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 18:52:35.151725 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:52:35.151725 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 18:52:35.151725 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 18:52:35.151725 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 16 18:52:35.151725 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi Jun 16 18:52:35.151725 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:52:35.151725 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi Jun 16 18:52:35.151725 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:52:35.151725 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:52:35.151725 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:52:35.152925 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:52:35.152925 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:52:35.152925 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:52:35.152925 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:52:35.152925 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 18:52:35.152925 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:52:35.152925 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 16 18:52:35.152925 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi Jun 16 18:52:35.152925 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:52:35.152925 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi Jun 16 18:52:35.152925 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:52:35.152925 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:52:35.152925 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:52:35.152925 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:52:35.152925 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:52:35.152925 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 16 18:52:35.152925 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi Jun 16 18:52:35.152925 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-a2772e20-57fb-4af5-858e-2be42560e7ed admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:52:35.154112 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-a2772e20-57fb-4af5-858e-2be42560e7ed admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.068090 Jun 16 18:52:35.154112 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 19/39] 10.222.0.70 () {60 vars in 1190 bytes} [Thu Jun 16 18:52:35 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 18:52:35.160625 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-1b579f0d-4a8e-4cfc-8a7e-df6cde032c4c admin admin] Calling method '>' {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:35.163640 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG dbcounter [-] [103269] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:52:35.187313 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-1b579f0d-4a8e-4cfc-8a7e-df6cde032c4c admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029979 Jun 16 18:52:35.188168 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 21/40] 10.222.0.70 () {60 vars in 1210 bytes} [Thu Jun 16 18:52:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:52:35.200799 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-13f7beba-e853-4a87-9273-fcb2ecce4829 admin admin] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:35.222837 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-13f7beba-e853-4a87-9273-fcb2ecce4829 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026188 Jun 16 18:52:35.223393 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 20/41] 10.222.0.70 () {60 vars in 1210 bytes} [Thu Jun 16 18:52:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:52:35.233835 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-34c3f4db-2da3-47f9-8b4a-4403263c0387 admin admin] Calling method '>' {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:35.239764 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.wsgi [None req-34c3f4db-2da3-47f9-8b4a-4403263c0387 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 16 18:52:35.243066 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-34c3f4db-2da3-47f9-8b4a-4403263c0387 admin admin] Request method failure captured: Jun 16 18:52:35.243066 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 16 18:52:35.243066 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: Accept: application/json Jun 16 18:52:35.243066 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: Accept-Encoding: gzip, deflate Jun 16 18:52:35.243066 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: Connection: keep-alive Jun 16 18:52:35.243066 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: Content-Length: 0 Jun 16 18:52:35.243066 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: Host: 10.222.0.70 Jun 16 18:52:35.243066 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: Openstack-Api-Version: compute 2.90 Jun 16 18:52:35.243066 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: Openstack-System-Scope: None Jun 16 18:52:35.243066 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: User-Agent: python-novaclient Jun 16 18:52:35.243066 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: X-Auth-Token: gAAAAABiq3vyFlkUJWlCV0mJ6rywCWxGzEm-v2XNMMrh29utVyV9XlIyreh8IYlaKNYUdIQTV13baXTyHoQITsY3ibXWwUKmHEGCdipieqRKk3iQZa4VIlkFjlb5dlZwAYd4S0NfJIIw4-mJ0OA8AjUxnOUtpmRkip_YqTOfrsRdRmO_3VA5Td4 Jun 16 18:52:35.243066 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: X-Domain-Id: None Jun 16 18:52:35.243066 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: X-Domain-Name: None Jun 16 18:52:35.243066 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: X-Identity-Status: Confirmed Jun 16 18:52:35.243066 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: X-Is-Admin-Project: True Jun 16 18:52:35.243066 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 18:52:35.243066 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: X-Project-Domain-Id: default Jun 16 18:52:35.243066 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: X-Project-Domain-Name: Default Jun 16 18:52:35.243066 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: X-Project-Id: 417f1f7349214e82b739864de0303f59 Jun 16 18:52:35.243066 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: X-Project-Name: admin Jun 16 18:52:35.243066 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: X-Role: member,reader,admin Jun 16 18:52:35.243066 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: X-Roles: member,reader,admin Jun 16 18:52:35.244722 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/417f1f7349214e82b739864de0303f59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_417f1f7349214e82b739864de0303f59", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/417f1f7349214e82b739864de0303f59"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/417f1f7349214e82b739864de0303f59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 16 18:52:35.244722 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: X-Tenant: admin Jun 16 18:52:35.244722 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: X-Tenant-Id: 417f1f7349214e82b739864de0303f59 Jun 16 18:52:35.244722 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: X-Tenant-Name: admin Jun 16 18:52:35.244722 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: X-User: admin Jun 16 18:52:35.244722 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: X-User-Domain-Id: default Jun 16 18:52:35.244722 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: X-User-Domain-Name: Default Jun 16 18:52:35.244722 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: X-User-Id: 7e2576df31cd4791832f5441b6f98ba5 Jun 16 18:52:35.244722 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: X-User-Name: admin Jun 16 18:52:35.244722 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: method: > Jun 16 18:52:35.244722 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: exception: Flavor 42 could not be found. Jun 16 18:52:35.244722 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: action_args: {'id': '42'} Jun 16 18:52:35.244722 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:52:35.244722 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:52:35.246017 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 18:52:35.246017 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 18:52:35.246017 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 18:52:35.246017 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 18:52:35.246017 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 18:52:35.246017 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 18:52:35.246017 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 18:52:35.246017 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 18:52:35.246017 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 18:52:35.246017 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:52:35.246017 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 18:52:35.246017 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 18:52:35.246017 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 16 18:52:35.246017 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi Jun 16 18:52:35.246017 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:52:35.246017 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi Jun 16 18:52:35.246017 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:52:35.246017 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:52:35.246017 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:52:35.247317 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:52:35.247317 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:52:35.247317 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:52:35.247317 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:52:35.247317 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 18:52:35.247317 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:52:35.247317 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 16 18:52:35.247317 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi Jun 16 18:52:35.247317 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:52:35.247317 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi Jun 16 18:52:35.247317 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:52:35.247317 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:52:35.247317 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:52:35.247317 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:52:35.247317 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:52:35.247317 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 16 18:52:35.247317 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi Jun 16 18:52:35.247317 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-34c3f4db-2da3-47f9-8b4a-4403263c0387 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:52:35.248536 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-34c3f4db-2da3-47f9-8b4a-4403263c0387 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014574 Jun 16 18:52:35.248536 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 22/42] 10.222.0.70 () {60 vars in 1190 bytes} [Thu Jun 16 18:52:35 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 18:52:36.141289 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-13f7beba-e853-4a87-9273-fcb2ecce4829 admin admin] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:36.142300 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-13f7beba-e853-4a87-9273-fcb2ecce4829 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Jun 16 18:52:36.142729 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 21/43] 10.222.0.70 () {56 vars in 1074 bytes} [Thu Jun 16 18:52:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:52:36.341765 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-e1da6aae-1fcb-4b17-946a-bab5d2a766c1 admin admin] Calling method '>' {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:36.347419 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.wsgi [None req-e1da6aae-1fcb-4b17-946a-bab5d2a766c1 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 16 18:52:36.349457 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-e1da6aae-1fcb-4b17-946a-bab5d2a766c1 admin admin] Request method failure captured: Jun 16 18:52:36.349457 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 16 18:52:36.349457 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: Accept: application/json Jun 16 18:52:36.349457 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: Accept-Encoding: gzip, deflate Jun 16 18:52:36.349457 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: Connection: keep-alive Jun 16 18:52:36.349457 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: Content-Length: 0 Jun 16 18:52:36.349457 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: Host: 10.222.0.70 Jun 16 18:52:36.349457 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: Openstack-Api-Version: compute 2.90 Jun 16 18:52:36.349457 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: Openstack-System-Scope: None Jun 16 18:52:36.349457 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: User-Agent: python-novaclient Jun 16 18:52:36.349457 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: X-Auth-Token: gAAAAABiq3v0XIPGD9s_BuEQr-jwqV-prgSx0F212ylAn6lyyEZd-7qaSTGbHUvNu1wDA7wyl9KLCysJUE3OCVUN6jhlIPoMxN08Pp526_IzXQu9vCI9g0MZGJdsPCfJhZgLslU1F8AHhzOu5DC7UhIX1MHd6OHUfmgSql38_ZZ50S978Kj2bmo Jun 16 18:52:36.349457 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: X-Domain-Id: None Jun 16 18:52:36.349457 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: X-Domain-Name: None Jun 16 18:52:36.349457 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: X-Identity-Status: Confirmed Jun 16 18:52:36.349457 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: X-Is-Admin-Project: True Jun 16 18:52:36.349457 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 18:52:36.349457 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: X-Project-Domain-Id: default Jun 16 18:52:36.349457 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: X-Project-Domain-Name: Default Jun 16 18:52:36.349457 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: X-Project-Id: 417f1f7349214e82b739864de0303f59 Jun 16 18:52:36.349457 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: X-Project-Name: admin Jun 16 18:52:36.349457 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: X-Role: member,reader,admin Jun 16 18:52:36.349457 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: X-Roles: member,reader,admin Jun 16 18:52:36.352182 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/417f1f7349214e82b739864de0303f59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_417f1f7349214e82b739864de0303f59", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/417f1f7349214e82b739864de0303f59"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/417f1f7349214e82b739864de0303f59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 16 18:52:36.352182 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: X-Tenant: admin Jun 16 18:52:36.352182 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: X-Tenant-Id: 417f1f7349214e82b739864de0303f59 Jun 16 18:52:36.352182 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: X-Tenant-Name: admin Jun 16 18:52:36.352182 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: X-User: admin Jun 16 18:52:36.352182 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: X-User-Domain-Id: default Jun 16 18:52:36.352182 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: X-User-Domain-Name: Default Jun 16 18:52:36.352182 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: X-User-Id: 7e2576df31cd4791832f5441b6f98ba5 Jun 16 18:52:36.352182 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: X-User-Name: admin Jun 16 18:52:36.352182 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: method: > Jun 16 18:52:36.352182 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: exception: Flavor 84 could not be found. Jun 16 18:52:36.352182 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: action_args: {'id': '84'} Jun 16 18:52:36.352182 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:52:36.352182 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:52:36.355251 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 18:52:36.355251 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 18:52:36.355251 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 18:52:36.355251 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 18:52:36.355251 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 18:52:36.355251 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 18:52:36.355251 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 18:52:36.355251 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 18:52:36.355251 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 18:52:36.355251 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:52:36.355251 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 18:52:36.355251 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 18:52:36.355251 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 16 18:52:36.355251 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi Jun 16 18:52:36.355251 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:52:36.355251 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi Jun 16 18:52:36.355251 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:52:36.355251 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:52:36.355251 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:52:36.358486 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:52:36.358486 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:52:36.358486 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:52:36.358486 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:52:36.358486 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 18:52:36.358486 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:52:36.358486 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 16 18:52:36.358486 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi Jun 16 18:52:36.358486 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:52:36.358486 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi Jun 16 18:52:36.358486 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:52:36.358486 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:52:36.358486 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:52:36.358486 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:52:36.358486 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:52:36.358486 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 16 18:52:36.358486 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi Jun 16 18:52:36.358486 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-e1da6aae-1fcb-4b17-946a-bab5d2a766c1 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:52:36.361015 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-e1da6aae-1fcb-4b17-946a-bab5d2a766c1 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.066044 Jun 16 18:52:36.361015 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 23/44] 10.222.0.70 () {60 vars in 1190 bytes} [Thu Jun 16 18:52:36 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 18:52:36.367239 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-45d9fab8-4fdf-4ecc-9416-bf04735dbfe8 admin admin] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:36.385795 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-45d9fab8-4fdf-4ecc-9416-bf04735dbfe8 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.022680 Jun 16 18:52:36.386539 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 22/45] 10.222.0.70 () {60 vars in 1210 bytes} [Thu Jun 16 18:52:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:52:36.397204 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-ebb60158-b58b-4ef0-b118-fd929c3c59e5 admin admin] Calling method '>' {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:36.411549 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-ebb60158-b58b-4ef0-b118-fd929c3c59e5 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018213 Jun 16 18:52:36.412106 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 24/46] 10.222.0.70 () {60 vars in 1210 bytes} [Thu Jun 16 18:52:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:52:36.423438 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-500f27ea-3153-4392-9152-61431c132c87 admin admin] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:36.429605 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.wsgi [None req-500f27ea-3153-4392-9152-61431c132c87 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 16 18:52:36.431180 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-500f27ea-3153-4392-9152-61431c132c87 admin admin] Request method failure captured: Jun 16 18:52:36.431180 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 16 18:52:36.431180 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: Accept: application/json Jun 16 18:52:36.431180 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: Accept-Encoding: gzip, deflate Jun 16 18:52:36.431180 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: Connection: keep-alive Jun 16 18:52:36.431180 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: Content-Length: 0 Jun 16 18:52:36.431180 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: Host: 10.222.0.70 Jun 16 18:52:36.431180 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: Openstack-Api-Version: compute 2.90 Jun 16 18:52:36.431180 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: Openstack-System-Scope: None Jun 16 18:52:36.431180 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: User-Agent: python-novaclient Jun 16 18:52:36.431180 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: X-Auth-Token: gAAAAABiq3v0XIPGD9s_BuEQr-jwqV-prgSx0F212ylAn6lyyEZd-7qaSTGbHUvNu1wDA7wyl9KLCysJUE3OCVUN6jhlIPoMxN08Pp526_IzXQu9vCI9g0MZGJdsPCfJhZgLslU1F8AHhzOu5DC7UhIX1MHd6OHUfmgSql38_ZZ50S978Kj2bmo Jun 16 18:52:36.431180 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: X-Domain-Id: None Jun 16 18:52:36.431180 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: X-Domain-Name: None Jun 16 18:52:36.431180 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: X-Identity-Status: Confirmed Jun 16 18:52:36.431180 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: X-Is-Admin-Project: True Jun 16 18:52:36.431180 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 18:52:36.431180 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: X-Project-Domain-Id: default Jun 16 18:52:36.431180 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: X-Project-Domain-Name: Default Jun 16 18:52:36.431180 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: X-Project-Id: 417f1f7349214e82b739864de0303f59 Jun 16 18:52:36.431180 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: X-Project-Name: admin Jun 16 18:52:36.431180 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: X-Role: member,reader,admin Jun 16 18:52:36.431180 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: X-Roles: member,reader,admin Jun 16 18:52:36.434945 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/417f1f7349214e82b739864de0303f59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_417f1f7349214e82b739864de0303f59", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/417f1f7349214e82b739864de0303f59"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/417f1f7349214e82b739864de0303f59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 16 18:52:36.434945 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: X-Tenant: admin Jun 16 18:52:36.434945 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: X-Tenant-Id: 417f1f7349214e82b739864de0303f59 Jun 16 18:52:36.434945 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: X-Tenant-Name: admin Jun 16 18:52:36.434945 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: X-User: admin Jun 16 18:52:36.434945 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: X-User-Domain-Id: default Jun 16 18:52:36.434945 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: X-User-Domain-Name: Default Jun 16 18:52:36.434945 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: X-User-Id: 7e2576df31cd4791832f5441b6f98ba5 Jun 16 18:52:36.434945 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: X-User-Name: admin Jun 16 18:52:36.434945 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: method: > Jun 16 18:52:36.434945 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: exception: Flavor 84 could not be found. Jun 16 18:52:36.434945 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: action_args: {'id': '84'} Jun 16 18:52:36.434945 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:52:36.434945 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:52:36.436221 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 18:52:36.436221 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 18:52:36.436221 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 18:52:36.436221 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 18:52:36.436221 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 18:52:36.436221 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 18:52:36.436221 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 18:52:36.436221 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 18:52:36.436221 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 18:52:36.436221 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:52:36.436221 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 18:52:36.436221 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 18:52:36.436221 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 16 18:52:36.436221 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi Jun 16 18:52:36.436221 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:52:36.436221 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi Jun 16 18:52:36.436221 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:52:36.436221 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:52:36.436221 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:52:36.437598 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:52:36.437598 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:52:36.437598 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:52:36.437598 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:52:36.437598 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 18:52:36.437598 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:52:36.437598 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 16 18:52:36.437598 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi Jun 16 18:52:36.437598 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:52:36.437598 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi Jun 16 18:52:36.437598 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:52:36.437598 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:52:36.437598 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:52:36.437598 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:52:36.437598 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:52:36.437598 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 16 18:52:36.437598 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi Jun 16 18:52:36.437598 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-500f27ea-3153-4392-9152-61431c132c87 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:52:36.439025 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-500f27ea-3153-4392-9152-61431c132c87 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.013552 Jun 16 18:52:36.439025 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 23/47] 10.222.0.70 () {60 vars in 1190 bytes} [Thu Jun 16 18:52:36 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 16 18:52:37.406928 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-ebb60158-b58b-4ef0-b118-fd929c3c59e5 admin admin] Calling method '>' {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:37.408260 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-ebb60158-b58b-4ef0-b118-fd929c3c59e5 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Jun 16 18:52:37.408657 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 25/48] 10.222.0.70 () {56 vars in 1074 bytes} [Thu Jun 16 18:52:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:52:37.652441 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-e569ee19-dc43-4dd6-b863-302ca73e8c5f admin admin] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:37.661162 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.wsgi [None req-e569ee19-dc43-4dd6-b863-302ca73e8c5f admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 16 18:52:37.662718 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-e569ee19-dc43-4dd6-b863-302ca73e8c5f admin admin] Request method failure captured: Jun 16 18:52:37.662718 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 16 18:52:37.662718 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: Accept: application/json Jun 16 18:52:37.662718 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: Accept-Encoding: gzip, deflate Jun 16 18:52:37.662718 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: Connection: keep-alive Jun 16 18:52:37.662718 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: Content-Length: 0 Jun 16 18:52:37.662718 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: Host: 10.222.0.70 Jun 16 18:52:37.662718 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: Openstack-Api-Version: compute 2.90 Jun 16 18:52:37.662718 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: Openstack-System-Scope: None Jun 16 18:52:37.662718 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: User-Agent: python-novaclient Jun 16 18:52:37.662718 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: X-Auth-Token: gAAAAABiq3v1sBh_uRUbH2OpuHEbyPBsY7Juk-juoZst1mGWbvQBosrbwee-y8aotHvjp9TUtDkMp5dZ7ywq9GVANaAxXMjSYm5KM4WKfJLQVTrZWL7kWgjz29G5wYP6fcOVMYuKH3R8ZlQosNxWseO6kjtkGHSDeGOmhoYcCqFjyOgTCF4Uy38 Jun 16 18:52:37.662718 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: X-Domain-Id: None Jun 16 18:52:37.662718 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: X-Domain-Name: None Jun 16 18:52:37.662718 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: X-Identity-Status: Confirmed Jun 16 18:52:37.662718 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: X-Is-Admin-Project: True Jun 16 18:52:37.662718 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 18:52:37.662718 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: X-Project-Domain-Id: default Jun 16 18:52:37.662718 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: X-Project-Domain-Name: Default Jun 16 18:52:37.662718 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: X-Project-Id: 417f1f7349214e82b739864de0303f59 Jun 16 18:52:37.662718 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: X-Project-Name: admin Jun 16 18:52:37.662718 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: X-Role: member,reader,admin Jun 16 18:52:37.662718 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: X-Roles: member,reader,admin Jun 16 18:52:37.664979 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/417f1f7349214e82b739864de0303f59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_417f1f7349214e82b739864de0303f59", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/417f1f7349214e82b739864de0303f59"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/417f1f7349214e82b739864de0303f59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 16 18:52:37.664979 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: X-Tenant: admin Jun 16 18:52:37.664979 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: X-Tenant-Id: 417f1f7349214e82b739864de0303f59 Jun 16 18:52:37.664979 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: X-Tenant-Name: admin Jun 16 18:52:37.664979 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: X-User: admin Jun 16 18:52:37.664979 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: X-User-Domain-Id: default Jun 16 18:52:37.664979 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: X-User-Domain-Name: Default Jun 16 18:52:37.664979 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: X-User-Id: 7e2576df31cd4791832f5441b6f98ba5 Jun 16 18:52:37.664979 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: X-User-Name: admin Jun 16 18:52:37.664979 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: method: > Jun 16 18:52:37.664979 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: exception: Flavor 451 could not be found. Jun 16 18:52:37.664979 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: action_args: {'id': '451'} Jun 16 18:52:37.664979 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:52:37.664979 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:52:37.665915 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 18:52:37.665915 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 18:52:37.665915 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 18:52:37.665915 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 18:52:37.665915 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 18:52:37.665915 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 18:52:37.665915 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 18:52:37.665915 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 18:52:37.665915 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 18:52:37.665915 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:52:37.665915 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 18:52:37.665915 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 18:52:37.665915 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 16 18:52:37.665915 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi Jun 16 18:52:37.665915 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:52:37.665915 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi Jun 16 18:52:37.665915 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:52:37.665915 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:52:37.665915 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:52:37.670099 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:52:37.670099 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:52:37.670099 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:52:37.670099 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:52:37.670099 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 18:52:37.670099 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:52:37.670099 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 16 18:52:37.670099 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi Jun 16 18:52:37.670099 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:52:37.670099 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi Jun 16 18:52:37.670099 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:52:37.670099 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:52:37.670099 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:52:37.670099 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:52:37.670099 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:52:37.670099 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 16 18:52:37.670099 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: ERROR nova.api.openstack.wsgi Jun 16 18:52:37.670099 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-e569ee19-dc43-4dd6-b863-302ca73e8c5f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:52:37.672097 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-e569ee19-dc43-4dd6-b863-302ca73e8c5f admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.093212 Jun 16 18:52:37.672097 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 24/49] 10.222.0.70 () {60 vars in 1193 bytes} [Thu Jun 16 18:52:37 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 18:52:37.680049 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-937293be-32d1-43b7-9627-67fad6ceef3d admin admin] Calling method '>' {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:37.698827 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-937293be-32d1-43b7-9627-67fad6ceef3d admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025544 Jun 16 18:52:37.699382 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 26/50] 10.222.0.70 () {60 vars in 1210 bytes} [Thu Jun 16 18:52:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:52:37.709705 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-f2609631-1378-4dc8-9c5b-3599313f7229 admin admin] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:37.728586 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-f2609631-1378-4dc8-9c5b-3599313f7229 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.022670 Jun 16 18:52:37.731665 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 25/51] 10.222.0.70 () {60 vars in 1210 bytes} [Thu Jun 16 18:52:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 18:52:37.749847 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-5a1a7467-e192-486b-8504-da575784c6b0 admin admin] Calling method '>' {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:37.758439 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.wsgi [None req-5a1a7467-e192-486b-8504-da575784c6b0 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 16 18:52:37.761082 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-5a1a7467-e192-486b-8504-da575784c6b0 admin admin] Request method failure captured: Jun 16 18:52:37.761082 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 16 18:52:37.761082 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: Accept: application/json Jun 16 18:52:37.761082 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: Accept-Encoding: gzip, deflate Jun 16 18:52:37.761082 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: Connection: keep-alive Jun 16 18:52:37.761082 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: Content-Length: 0 Jun 16 18:52:37.761082 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: Host: 10.222.0.70 Jun 16 18:52:37.761082 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: Openstack-Api-Version: compute 2.90 Jun 16 18:52:37.761082 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: Openstack-System-Scope: None Jun 16 18:52:37.761082 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: User-Agent: python-novaclient Jun 16 18:52:37.761082 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: X-Auth-Token: gAAAAABiq3v1sBh_uRUbH2OpuHEbyPBsY7Juk-juoZst1mGWbvQBosrbwee-y8aotHvjp9TUtDkMp5dZ7ywq9GVANaAxXMjSYm5KM4WKfJLQVTrZWL7kWgjz29G5wYP6fcOVMYuKH3R8ZlQosNxWseO6kjtkGHSDeGOmhoYcCqFjyOgTCF4Uy38 Jun 16 18:52:37.761082 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: X-Domain-Id: None Jun 16 18:52:37.761082 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: X-Domain-Name: None Jun 16 18:52:37.761082 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: X-Identity-Status: Confirmed Jun 16 18:52:37.761082 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: X-Is-Admin-Project: True Jun 16 18:52:37.761082 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 18:52:37.761082 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: X-Project-Domain-Id: default Jun 16 18:52:37.761082 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: X-Project-Domain-Name: Default Jun 16 18:52:37.761082 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: X-Project-Id: 417f1f7349214e82b739864de0303f59 Jun 16 18:52:37.761082 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: X-Project-Name: admin Jun 16 18:52:37.761082 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: X-Role: member,reader,admin Jun 16 18:52:37.761082 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: X-Roles: member,reader,admin Jun 16 18:52:37.762618 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/417f1f7349214e82b739864de0303f59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_417f1f7349214e82b739864de0303f59", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/417f1f7349214e82b739864de0303f59"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/417f1f7349214e82b739864de0303f59"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 16 18:52:37.762618 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: X-Tenant: admin Jun 16 18:52:37.762618 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: X-Tenant-Id: 417f1f7349214e82b739864de0303f59 Jun 16 18:52:37.762618 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: X-Tenant-Name: admin Jun 16 18:52:37.762618 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: X-User: admin Jun 16 18:52:37.762618 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: X-User-Domain-Id: default Jun 16 18:52:37.762618 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: X-User-Domain-Name: Default Jun 16 18:52:37.762618 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: X-User-Id: 7e2576df31cd4791832f5441b6f98ba5 Jun 16 18:52:37.762618 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: X-User-Name: admin Jun 16 18:52:37.762618 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: method: > Jun 16 18:52:37.762618 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: exception: Flavor 451 could not be found. Jun 16 18:52:37.762618 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: action_args: {'id': '451'} Jun 16 18:52:37.762618 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:52:37.762618 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:52:37.763568 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 18:52:37.763568 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 18:52:37.763568 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 18:52:37.763568 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 18:52:37.763568 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 18:52:37.763568 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 18:52:37.763568 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 18:52:37.763568 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 18:52:37.763568 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 18:52:37.763568 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:52:37.763568 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 18:52:37.763568 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 18:52:37.763568 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 16 18:52:37.763568 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi Jun 16 18:52:37.763568 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:52:37.763568 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi Jun 16 18:52:37.763568 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:52:37.763568 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:52:37.763568 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:52:37.765184 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:52:37.765184 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:52:37.765184 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:52:37.765184 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:52:37.765184 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 18:52:37.765184 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:52:37.765184 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 16 18:52:37.765184 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi Jun 16 18:52:37.765184 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:52:37.765184 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi Jun 16 18:52:37.765184 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:52:37.765184 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:52:37.765184 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:52:37.765184 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:52:37.765184 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:52:37.765184 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 16 18:52:37.765184 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: ERROR nova.api.openstack.wsgi Jun 16 18:52:37.765184 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-5a1a7467-e192-486b-8504-da575784c6b0 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103269) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:52:37.766817 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-5a1a7467-e192-486b-8504-da575784c6b0 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.019762 Jun 16 18:52:37.766817 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 27/52] 10.222.0.70 () {60 vars in 1193 bytes} [Thu Jun 16 18:52:37 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 18:52:38.721245 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-f2609631-1378-4dc8-9c5b-3599313f7229 admin admin] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:38.722798 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-f2609631-1378-4dc8-9c5b-3599313f7229 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002376 Jun 16 18:52:38.723229 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 26/53] 10.222.0.70 () {56 vars in 1074 bytes} [Thu Jun 16 18:52:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:52:38.935783 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-893d8b53-6929-446c-98ce-aea26974e856 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:52:38.961772 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-893d8b53-6929-446c-98ce-aea26974e856 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.087985 Jun 16 18:52:38.962333 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 28/54] 10.222.0.70 () {64 vars in 1235 bytes} [Thu Jun 16 18:52:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:52:39.907070 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-f2609631-1378-4dc8-9c5b-3599313f7229 admin admin] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:39.908088 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-f2609631-1378-4dc8-9c5b-3599313f7229 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Jun 16 18:52:39.908515 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 27/55] 10.222.0.70 () {56 vars in 1074 bytes} [Thu Jun 16 18:52:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:52:40.127095 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-c109901b-d1cd-4cf1-be53-b4ff8d58be97 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:52:40.147564 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-c109901b-d1cd-4cf1-be53-b4ff8d58be97 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.085673 Jun 16 18:52:40.148109 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 29/56] 10.222.0.70 () {64 vars in 1235 bytes} [Thu Jun 16 18:52:40 2022] POST /compute/v2.1/flavors => generated 405 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 18:52:41.073393 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-f2609631-1378-4dc8-9c5b-3599313f7229 admin admin] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:41.074627 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-f2609631-1378-4dc8-9c5b-3599313f7229 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001802 Jun 16 18:52:41.075193 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 28/57] 10.222.0.70 () {56 vars in 1074 bytes} [Thu Jun 16 18:52:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:52:41.288512 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-1c850654-b7f0-47c7-a32d-6707b1a5b026 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:52:41.312541 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-1c850654-b7f0-47c7-a32d-6707b1a5b026 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.088738 Jun 16 18:52:41.313173 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 30/58] 10.222.0.70 () {64 vars in 1235 bytes} [Thu Jun 16 18:52:41 2022] POST /compute/v2.1/flavors => generated 407 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:52:42.294933 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-f2609631-1378-4dc8-9c5b-3599313f7229 admin admin] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:42.295988 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-f2609631-1378-4dc8-9c5b-3599313f7229 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Jun 16 18:52:42.296396 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 29/59] 10.222.0.70 () {56 vars in 1074 bytes} [Thu Jun 16 18:52:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:52:42.499646 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-94620a1b-5fd7-4960-a05f-f27e35df7b1c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:52:42.518655 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-94620a1b-5fd7-4960-a05f-f27e35df7b1c admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.078695 Jun 16 18:52:42.519195 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 31/60] 10.222.0.70 () {64 vars in 1235 bytes} [Thu Jun 16 18:52:42 2022] POST /compute/v2.1/flavors => generated 409 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:52:43.453573 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-f2609631-1378-4dc8-9c5b-3599313f7229 admin admin] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:43.454674 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-f2609631-1378-4dc8-9c5b-3599313f7229 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jun 16 18:52:43.454988 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 30/61] 10.222.0.70 () {56 vars in 1074 bytes} [Thu Jun 16 18:52:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:52:43.664497 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-05bbf770-042b-4dc6-b903-ee53def76397 admin admin] Calling method '>' {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:52:43.686307 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-05bbf770-042b-4dc6-b903-ee53def76397 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.081081 Jun 16 18:52:43.686941 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 32/62] 10.222.0.70 () {60 vars in 1202 bytes} [Thu Jun 16 18:52:43 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:53:34.312176 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-f2609631-1378-4dc8-9c5b-3599313f7229 admin admin] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:34.313202 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-f2609631-1378-4dc8-9c5b-3599313f7229 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Jun 16 18:53:34.313619 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 31/63] 10.222.0.70 () {54 vars in 930 bytes} [Thu Jun 16 18:53:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:53:34.325894 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG dbcounter [-] [103269] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:53:34.379433 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-2dfa7cf7-121f-476b-a69f-37f099bf1ae4 admin admin] Calling method '>' {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:34.401721 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-2dfa7cf7-121f-476b-a69f-37f099bf1ae4 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.081217 Jun 16 18:53:34.402281 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 33/64] 10.222.0.70 () {60 vars in 1291 bytes} [Thu Jun 16 18:53:34 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:53:34.432931 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-d9858746-631b-414f-93e6-865089e6c212 admin admin] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:34.436879 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG dbcounter [-] [103268] Writing DB stats nova_api:SELECT=14 {{(pid=103268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:53:34.443824 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-d9858746-631b-414f-93e6-865089e6c212 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.015439 Jun 16 18:53:34.444396 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 32/65] 10.222.0.70 () {60 vars in 1282 bytes} [Thu Jun 16 18:53:34 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:34.459831 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-408a6339-d077-40ae-a33f-f015e6fd81d4 admin admin] Calling method '>' {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:34.468153 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-408a6339-d077-40ae-a33f-f015e6fd81d4 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012036 Jun 16 18:53:34.468704 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 34/66] 10.222.0.70 () {60 vars in 1285 bytes} [Thu Jun 16 18:53:34 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:53:34.480756 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-eeab0df8-71f3-4e5c-9280-88179aef6152 admin admin] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:34.489075 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-eeab0df8-71f3-4e5c-9280-88179aef6152 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012320 Jun 16 18:53:34.489612 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 33/67] 10.222.0.70 () {60 vars in 1285 bytes} [Thu Jun 16 18:53:34 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:53:34.502616 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-340d4735-0442-4568-86c0-6a5ae103de07 admin admin] Calling method '>' {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:53:34.511207 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-340d4735-0442-4568-86c0-6a5ae103de07 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011514 Jun 16 18:53:34.511845 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 35/68] 10.222.0.70 () {60 vars in 1282 bytes} [Thu Jun 16 18:53:34 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:57:03.262134 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-eeab0df8-71f3-4e5c-9280-88179aef6152 admin admin] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:03.263327 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-eeab0df8-71f3-4e5c-9280-88179aef6152 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001639 Jun 16 18:57:03.263735 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 34/69] 10.222.0.70 () {56 vars in 1074 bytes} [Thu Jun 16 18:57:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:57:03.423545 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG dbcounter [-] [103269] Writing DB stats nova_api:SELECT=6 {{(pid=103269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:03.544158 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-e10ff52e-8717-4461-9f8b-b368d1da5a22 admin admin] Calling method '>' {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:03.545323 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:57:03.545323 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: warnings.warn(msg) Jun 16 18:57:03.546521 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG oslo_concurrency.lockutils [None req-e10ff52e-8717-4461-9f8b-b368d1da5a22 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:03.546987 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG oslo_concurrency.lockutils [None req-e10ff52e-8717-4461-9f8b-b368d1da5a22 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:03.547780 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG oslo_concurrency.lockutils [None req-e10ff52e-8717-4461-9f8b-b368d1da5a22 admin admin] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:03.548210 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG oslo_concurrency.lockutils [None req-e10ff52e-8717-4461-9f8b-b368d1da5a22 admin admin] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:03.583504 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-e10ff52e-8717-4461-9f8b-b368d1da5a22 admin admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.161399 Jun 16 18:57:03.584659 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 36/70] 10.222.0.70 () {60 vars in 1193 bytes} [Thu Jun 16 18:57:03 2022] GET /compute/v2.1/os-services => generated 791 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:57:04.502610 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-eeab0df8-71f3-4e5c-9280-88179aef6152 admin admin] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:04.503625 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-eeab0df8-71f3-4e5c-9280-88179aef6152 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Jun 16 18:57:04.504040 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 35/71] 10.222.0.70 () {56 vars in 1074 bytes} [Thu Jun 16 18:57:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:57:04.701184 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-50430cf2-33d5-4194-b7ff-ad48e4961332 admin admin] Calling method '>' {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:04.702361 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:57:04.702361 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: warnings.warn(msg) Jun 16 18:57:04.703577 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG oslo_concurrency.lockutils [None req-50430cf2-33d5-4194-b7ff-ad48e4961332 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:04.704027 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG oslo_concurrency.lockutils [None req-50430cf2-33d5-4194-b7ff-ad48e4961332 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:04.704835 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG oslo_concurrency.lockutils [None req-50430cf2-33d5-4194-b7ff-ad48e4961332 admin admin] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:04.705275 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG oslo_concurrency.lockutils [None req-50430cf2-33d5-4194-b7ff-ad48e4961332 admin admin] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:04.727020 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-50430cf2-33d5-4194-b7ff-ad48e4961332 admin admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.081390 Jun 16 18:57:04.727513 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 37/72] 10.222.0.70 () {60 vars in 1193 bytes} [Thu Jun 16 18:57:04 2022] GET /compute/v2.1/os-services => generated 791 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 18:57:16.093680 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-eeab0df8-71f3-4e5c-9280-88179aef6152 admin admin] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:16.094713 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-eeab0df8-71f3-4e5c-9280-88179aef6152 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Jun 16 18:57:16.095108 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 36/73] 10.222.0.70 () {56 vars in 1074 bytes} [Thu Jun 16 18:57:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:57:16.243036 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG dbcounter [-] [103269] Writing DB stats nova_cell0:SELECT=4 {{(pid=103269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:16.243758 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG dbcounter [-] [103269] Writing DB stats nova_cell1:SELECT=4 {{(pid=103269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:16.244445 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG dbcounter [-] [103269] Writing DB stats nova_api:SELECT=8 {{(pid=103269) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:57:16.295742 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-73a9e3f6-be11-4f48-a46c-1dadf633b8b3 admin admin] Calling method '>' {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:16.296908 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:57:16.296908 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: warnings.warn(msg) Jun 16 18:57:16.298125 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG oslo_concurrency.lockutils [None req-73a9e3f6-be11-4f48-a46c-1dadf633b8b3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:16.298593 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG oslo_concurrency.lockutils [None req-73a9e3f6-be11-4f48-a46c-1dadf633b8b3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:16.299371 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG oslo_concurrency.lockutils [None req-73a9e3f6-be11-4f48-a46c-1dadf633b8b3 admin admin] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:16.299801 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG oslo_concurrency.lockutils [None req-73a9e3f6-be11-4f48-a46c-1dadf633b8b3 admin admin] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:16.325973 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-73a9e3f6-be11-4f48-a46c-1dadf633b8b3 admin admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.088251 Jun 16 18:57:16.326540 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 38/74] 10.222.0.70 () {60 vars in 1193 bytes} [Thu Jun 16 18:57:16 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:57:17.252025 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: DEBUG nova.api.openstack.wsgi [None req-eeab0df8-71f3-4e5c-9280-88179aef6152 admin admin] Calling method '>' {{(pid=103268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:17.253037 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: INFO nova.api.openstack.requestlog [None req-eeab0df8-71f3-4e5c-9280-88179aef6152 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Jun 16 18:57:17.253439 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: [pid: 103268|app: 0|req: 37/75] 10.222.0.70 () {56 vars in 1074 bytes} [Thu Jun 16 18:57:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:57:17.453438 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG nova.api.openstack.wsgi [None req-077a1ade-0cfc-467f-820b-beb7f31cdd74 admin admin] Calling method '>' {{(pid=103269) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:57:17.454620 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 18:57:17.454620 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: warnings.warn(msg) Jun 16 18:57:17.455826 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG oslo_concurrency.lockutils [None req-077a1ade-0cfc-467f-820b-beb7f31cdd74 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:17.456269 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG oslo_concurrency.lockutils [None req-077a1ade-0cfc-467f-820b-beb7f31cdd74 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:17.457053 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG oslo_concurrency.lockutils [None req-077a1ade-0cfc-467f-820b-beb7f31cdd74 admin admin] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:57:17.457479 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: DEBUG oslo_concurrency.lockutils [None req-077a1ade-0cfc-467f-820b-beb7f31cdd74 admin admin] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103269) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:57:17.481830 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: INFO nova.api.openstack.requestlog [None req-077a1ade-0cfc-467f-820b-beb7f31cdd74 admin admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.084717 Jun 16 18:57:17.482370 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: [pid: 103269|app: 0|req: 39/76] 10.222.0.70 () {60 vars in 1193 bytes} [Thu Jun 16 18:57:17 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:58:19.385364 dv-cinder-846172-1-iscsi devstack@n-api.service[103267]: Thu Jun 16 18:58:19 2022 - graceful shutdown triggered... Jun 16 18:58:19.385453 dv-cinder-846172-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 16 18:58:19.386490 dv-cinder-846172-1-iscsi devstack@n-api.service[103268]: Gracefully killing worker 1 (pid: 103268)... Jun 16 18:58:19.386931 dv-cinder-846172-1-iscsi devstack@n-api.service[103269]: Gracefully killing worker 2 (pid: 103269)... Jun 16 18:58:20.386791 dv-cinder-846172-1-iscsi devstack@n-api.service[103267]: worker 1 buried after 1 seconds Jun 16 18:58:20.386791 dv-cinder-846172-1-iscsi devstack@n-api.service[103267]: worker 2 buried after 1 seconds Jun 16 18:58:20.386791 dv-cinder-846172-1-iscsi devstack@n-api.service[103267]: goodbye to uWSGI. Jun 16 18:58:20.388224 dv-cinder-846172-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 16 18:58:20.388771 dv-cinder-846172-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 16 18:58:20.391564 dv-cinder-846172-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 16 18:58:20.402807 dv-cinder-846172-1-iscsi devstack@n-api.service[117837]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 16 18:58:20.405330 dv-cinder-846172-1-iscsi devstack@n-api.service[117837]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 16 18:58:20 2022] *** Jun 16 18:58:20.405330 dv-cinder-846172-1-iscsi devstack@n-api.service[117837]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 16 18:58:20.405330 dv-cinder-846172-1-iscsi devstack@n-api.service[117837]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 16 18:58:20.405330 dv-cinder-846172-1-iscsi devstack@n-api.service[117837]: nodename: dv-cinder-846172-1-iscsi Jun 16 18:58:20.405330 dv-cinder-846172-1-iscsi devstack@n-api.service[117837]: machine: x86_64 Jun 16 18:58:20.405330 dv-cinder-846172-1-iscsi devstack@n-api.service[117837]: clock source: unix Jun 16 18:58:20.405330 dv-cinder-846172-1-iscsi devstack@n-api.service[117837]: pcre jit disabled Jun 16 18:58:20.405330 dv-cinder-846172-1-iscsi devstack@n-api.service[117837]: detected number of CPU cores: 4 Jun 16 18:58:20.405330 dv-cinder-846172-1-iscsi devstack@n-api.service[117837]: current working directory: / Jun 16 18:58:20.405330 dv-cinder-846172-1-iscsi devstack@n-api.service[117837]: detected binary path: /usr/bin/uwsgi-core Jun 16 18:58:20.405330 dv-cinder-846172-1-iscsi devstack@n-api.service[117837]: your processes number limit is 47680 Jun 16 18:58:20.406135 dv-cinder-846172-1-iscsi devstack@n-api.service[117837]: your memory page size is 4096 bytes Jun 16 18:58:20.406135 dv-cinder-846172-1-iscsi devstack@n-api.service[117837]: detected max file descriptor number: 2048 Jun 16 18:58:20.406135 dv-cinder-846172-1-iscsi devstack@n-api.service[117837]: lock engine: pthread robust mutexes Jun 16 18:58:20.406135 dv-cinder-846172-1-iscsi devstack@n-api.service[117837]: thunder lock: enabled Jun 16 18:58:20.406135 dv-cinder-846172-1-iscsi devstack@n-api.service[117837]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 16 18:58:20.406135 dv-cinder-846172-1-iscsi devstack@n-api.service[117837]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 16 18:58:20.451049 dv-cinder-846172-1-iscsi devstack@n-api.service[117837]: Python main interpreter initialized at 0x558c699b79c0 Jun 16 18:58:20.451049 dv-cinder-846172-1-iscsi devstack@n-api.service[117837]: python threads support enabled Jun 16 18:58:20.451049 dv-cinder-846172-1-iscsi devstack@n-api.service[117837]: your server socket listen backlog is limited to 100 connections Jun 16 18:58:20.451049 dv-cinder-846172-1-iscsi devstack@n-api.service[117837]: your mercy for graceful operations on workers is 90 seconds Jun 16 18:58:20.451518 dv-cinder-846172-1-iscsi devstack@n-api.service[117837]: mapped 403077 bytes (393 KB) for 2 cores Jun 16 18:58:20.451518 dv-cinder-846172-1-iscsi devstack@n-api.service[117837]: *** Operational MODE: preforking *** Jun 16 18:58:20.451781 dv-cinder-846172-1-iscsi devstack@n-api.service[117837]: *** uWSGI is running in multiple interpreter mode *** Jun 16 18:58:20.451781 dv-cinder-846172-1-iscsi devstack@n-api.service[117837]: spawned uWSGI master process (pid: 117837) Jun 16 18:58:20.451986 dv-cinder-846172-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 16 18:58:20.452541 dv-cinder-846172-1-iscsi devstack@n-api.service[117837]: spawned uWSGI worker 1 (pid: 117850, cores: 1) Jun 16 18:58:20.453076 dv-cinder-846172-1-iscsi devstack@n-api.service[117837]: spawned uWSGI worker 2 (pid: 117852, cores: 1) Jun 16 18:58:20.453373 dv-cinder-846172-1-iscsi devstack@n-api.service[117837]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 16 18:58:21.153173 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 18:58:21.156794 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 18:58:22.454122 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 18:58:22.454122 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: from cryptography.utils import int_from_bytes Jun 16 18:58:22.454795 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 18:58:22.454795 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: from cryptography.utils import int_from_bytes Jun 16 18:58:22.473149 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 18:58:22.473149 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: from cryptography.utils import int_from_bytes Jun 16 18:58:22.473759 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 18:58:22.473759 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: from cryptography.utils import int_from_bytes Jun 16 18:58:24.959082 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 18:58:24.959082 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 18:58:24.959082 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 18:58:24.959082 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 18:58:24.959082 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 18:58:24.959082 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.959082 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.960028 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.960028 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.960028 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.960470 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.960633 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.960913 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.961248 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.961509 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.961830 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.962156 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846172-1-iscsi {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.962482 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.963852 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.964183 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.964516 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.964833 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.965166 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.965480 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.965996 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.966770 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.967088 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.967512 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.967864 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.968186 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.968504 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.968832 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.969147 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.969483 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.969803 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.970211 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846172-1-iscsi {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.970521 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.970883 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.971206 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.971631 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.975497 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.975497 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.975497 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.975497 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.975497 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.975944 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.976025 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.976347 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.976681 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.976997 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.977313 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.977627 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.978127 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.978443 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.978784 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.979040 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.979353 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.979676 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.980007 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.980340 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.980597 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.980851 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.981174 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.981498 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.981811 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.982123 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.982444 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.982788 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.983099 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.983411 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.983719 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.984195 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.984524 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.984846 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.985176 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.985489 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.985815 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.986229 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.70 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.986490 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.70 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.986845 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.987195 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.987589 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.988440 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.989181 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.989517 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.989836 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.990156 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.990473 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.990837 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.991185 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.991501 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.991759 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.992067 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.992383 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.992704 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.993018 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.993327 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.993638 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.993941 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.994405 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.994763 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.995080 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.995388 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.995701 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.996010 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.996321 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.996638 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.996948 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.997279 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.997603 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.997916 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.998222 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.998528 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.998867 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.999191 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.999502 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:24.999809 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.000135 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.000452 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.000757 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.001080 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.001391 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.001697 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.002018 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.002320 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.002668 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.002991 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.004046 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.004046 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.004046 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.004550 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.004743 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.004992 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.005306 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.005612 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.005916 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.006240 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.007161 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.007161 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.007478 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.007478 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.007801 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.008147 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.008501 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.009358 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.009358 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.009711 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.009870 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.010130 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.010448 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.010815 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.011146 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.011465 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.011784 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.012100 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.012416 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.012744 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.013080 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.013403 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.013727 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.014050 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.014518 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.014872 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.015208 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.015537 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.015851 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.016480 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.016849 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.017172 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.017501 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.017833 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.018150 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.018467 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.019084 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.019759 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.019759 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.020050 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.020221 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.020543 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.020838 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.021155 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.021551 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.021782 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.022128 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.022453 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.022797 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.023185 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.023434 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.023806 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.024062 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.024455 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.024713 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.025021 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.025330 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.025652 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.026207 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.026534 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.026901 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.027211 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.027550 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.027860 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.028176 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.028492 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.028808 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.029118 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.029431 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.029744 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.030052 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.030379 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.030720 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.031023 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.031347 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.031656 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.031963 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.032282 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.032595 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.032910 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.033203 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 18:58:25.033802 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.034044 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 18:58:25.034204 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.034204 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.035088 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 18:58:25.035784 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.036027 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 18:58:25.036123 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.036211 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 18:58:25.036303 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.036404 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.036500 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.036586 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.036676 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.036759 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.036840 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.036930 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.037023 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.037114 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.037205 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.037299 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.037382 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.037568 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.037670 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.037893 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.037986 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.038229 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.038323 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.038494 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.038615 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.038840 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.038933 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.039172 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846172-1-iscsi {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.039273 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.039483 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.039587 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.039792 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.039895 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.040103 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.040195 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.040417 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.040520 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.040729 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.040866 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.041042 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.041134 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.041352 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.041445 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.041663 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.041864 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.041971 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.042181 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.042303 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.042494 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.042638 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.042844 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.042986 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.043192 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.043364 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.043525 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.043673 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.043829 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.043980 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.044192 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.044338 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.044493 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.044632 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.044779 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.044971 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.045177 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.045338 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.045479 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.045704 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846172-1-iscsi {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.045864 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.046005 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.046145 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.046291 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.046437 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.046812 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.046988 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.047132 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.047275 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.047425 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.047570 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.047730 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.047875 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.048023 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.048269 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.048420 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.048574 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.048740 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.049886 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.050987 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.051135 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.053178 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.053341 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.053585 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.053683 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.053767 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.053855 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.053939 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.054012 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.054082 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.054082 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.054224 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.054297 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.054366 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.054443 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.054520 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.054622 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.054709 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.054790 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.054861 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.054931 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.055009 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.055090 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.055168 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.055247 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.055325 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.055403 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.055496 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.055570 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.055642 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.055711 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.055788 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.055860 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.055940 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.056014 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.056084 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.056161 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.056233 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.056316 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.056388 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.056457 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.056526 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.056595 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.056664 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.056741 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.056819 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.057092 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.057167 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.057247 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.057318 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.057397 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.057476 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.057554 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.057723 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.057828 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.058035 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.058144 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.058427 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.058537 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.058660 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.058750 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.059086 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.70 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.059186 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.059345 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.70 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.059489 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.059793 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.059938 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.060087 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.060227 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.060358 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.060489 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.060672 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.060775 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.061009 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.061120 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.061271 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.061372 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.061586 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.061685 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.061912 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.062175 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.062272 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.062347 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.062536 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.062711 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.062896 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.063132 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.063224 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.063306 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.063448 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.063573 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.063754 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.063846 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.064067 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.064149 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.064392 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.064488 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.064701 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.064834 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.065005 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.065171 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.065316 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.065440 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.065775 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.065915 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.066097 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.066242 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.066419 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.066517 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.066872 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.067009 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.067113 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.067201 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.067391 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.067534 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.067708 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.067808 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.068023 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.068115 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.068350 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.068442 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.068669 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.068761 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.068982 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.069074 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.069297 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.069399 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.069615 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.069705 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.069926 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.070023 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.070234 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.070332 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.070547 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.070721 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.070887 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.070978 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.071197 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.071295 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.071509 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.071608 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.071818 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.071908 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.072131 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.072213 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.072442 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.072524 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.072768 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.073023 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.073104 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.073366 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.073476 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.073683 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.073765 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.073988 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.074070 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.074299 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.074401 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.074643 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.074738 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.074958 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.075057 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.075273 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.075365 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.075586 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.075686 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.075899 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.076006 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.076219 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.076318 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.076525 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.076616 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.076831 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.076932 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.077141 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.077240 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.077448 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.077538 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.077753 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.077853 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.078061 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.078161 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.078375 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.078475 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.078706 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.078795 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.079029 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.079126 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.079319 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.079423 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 18:58:25.079628 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.079763 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.079945 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.080039 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.080249 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.080416 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.080563 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.080666 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.080869 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.081003 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.081223 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.081456 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.081740 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.081895 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.082037 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.082186 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.082345 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.082494 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.082787 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.082948 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.083126 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.083263 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.083367 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.083454 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.083528 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.083773 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.083876 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.084110 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.084213 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.084420 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.084519 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.084730 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.084822 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.085059 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.085152 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.085365 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.085465 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.085672 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.085763 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.085980 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.086073 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.086296 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.086396 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.086631 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.086738 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.086948 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.087041 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.087261 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.087360 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.087574 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.087667 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.087888 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.087989 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.088201 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.088300 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.088507 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.088656 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.088945 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.089092 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.089209 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.090019 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.090221 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.090396 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.090557 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.090736 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.090936 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.091089 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.091251 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.091416 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.091416 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.091709 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.091861 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.092016 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.092173 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.092340 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.092491 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.092640 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.092799 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.092949 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.093106 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.093275 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.093441 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.093595 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.093759 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.093910 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.093910 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.094204 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.094299 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.094381 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.094453 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.094536 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.094536 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.094733 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.094931 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.095233 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.095370 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.095548 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.095651 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.095859 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.095951 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.096276 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.096378 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.096495 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.096595 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.097382 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.097483 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.097705 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.097986 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.098078 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.098332 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.098414 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.098853 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.098981 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.099064 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.099160 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.099325 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.099449 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.099652 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.099769 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.099974 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.100078 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.100361 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.100467 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.100559 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.100654 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.100988 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.101104 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.101241 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.101335 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.101551 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.101645 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.101861 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.101953 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.102174 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.102308 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.102486 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.102624 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.102839 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.102934 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.103151 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.103255 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.103461 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.103552 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.103771 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.103865 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.104079 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.104175 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.104401 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.104509 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.104718 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.104812 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.105038 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.105132 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.105372 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.105473 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.105687 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.105786 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.106003 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.106094 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.106318 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.106416 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.106657 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.106767 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.106976 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.107074 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.107288 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.107453 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.107607 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.107706 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.107919 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.108020 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.108233 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.108334 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.108542 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.108635 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.108850 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.108941 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.109160 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.109242 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.109472 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.109553 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.109783 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.109864 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.110092 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.110173 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.110405 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.110495 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.110743 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.110890 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.111162 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.111259 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.111360 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.111443 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.111673 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.111765 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.111988 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.112079 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.112298 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.112414 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.113384 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.113501 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.113695 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.113980 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.114074 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.114352 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.114597 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.114846 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.114961 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.115081 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.115166 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.115403 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.115486 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.115720 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.115824 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.116038 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.116127 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.116364 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.116506 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.116685 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.116785 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.117003 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.117102 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.117319 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.117632 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.117732 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.117952 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.118062 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.118266 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.118357 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.118727 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.118827 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.118922 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.119026 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.119231 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.119327 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.119553 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.119677 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.119879 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.119996 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.120189 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.120316 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.120515 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.120628 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.120864 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.120956 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.121318 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.121436 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.121514 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.121585 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.121836 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.121937 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.122153 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.122258 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.122473 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.122592 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.122821 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.122915 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.123141 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.123242 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.123459 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.123550 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.123777 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.123931 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.124101 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.124204 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.124418 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.124552 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.124740 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.124858 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.125048 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.125186 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.125357 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.125531 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.125721 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.125844 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.125966 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.126080 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.126271 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.126394 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.126648 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.126774 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.126949 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.127069 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.127290 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.127421 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.127608 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.127739 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.127926 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.128089 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.128344 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.128522 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.128662 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.128791 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.129057 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.129189 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.129303 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.129572 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.129687 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.129812 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.129927 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.130038 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.130184 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.130303 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.130501 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.130651 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.130844 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.130962 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.131163 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.131302 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.131636 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.131763 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.131883 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.131994 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.132113 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.132224 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.132379 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.132510 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.132689 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.132825 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.133001 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.133118 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.133327 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.133463 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.133640 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.133766 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.133970 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.134077 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.134297 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.134400 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.134643 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.134791 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.134938 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.135046 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.135267 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.135359 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.135584 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.135676 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.135896 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.136046 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.136204 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.136308 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.136511 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.136640 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.136835 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.136947 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.137146 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.137247 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.137457 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.137550 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.137771 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.137875 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.138083 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.138177 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.138388 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.138480 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.138724 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.138831 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.139041 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.139133 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.139345 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.139457 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.139666 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.140142 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.140275 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.140650 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.140650 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.140897 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.141124 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.141262 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.141384 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.141528 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.141830 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.141921 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.142017 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.142110 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.142110 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.142281 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.142366 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.142456 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.142549 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.142708 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.142708 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.142865 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.143031 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.143178 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.143348 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.143476 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.143708 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.143814 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.144041 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.144333 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.144498 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.144671 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.144801 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.145108 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.145306 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.145306 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.145505 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.145632 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.145763 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.145929 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.146107 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.146230 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.146343 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.146532 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.146777 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.146869 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.146976 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.147176 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.147412 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.147508 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.147616 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.147780 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.147941 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.148092 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.148219 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.148397 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.148597 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.148703 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.148797 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.148995 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.149088 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.149318 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.149411 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.149623 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.149715 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.149931 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.150021 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.150241 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.150335 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.150545 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.150949 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.151189 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.151279 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.151429 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.151523 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.151837 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.151972 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.152085 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.152176 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.152344 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.152445 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.152675 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.152775 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.152991 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.153096 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.153301 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.153435 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.153611 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.153858 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.153971 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.154110 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.154239 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.154339 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.154553 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.154741 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.154892 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.154998 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.155208 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.155302 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.155525 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.155617 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.155840 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.155933 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.156155 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.156253 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.156466 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.156557 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.156781 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.156874 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.157105 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.157249 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.157398 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.157489 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.157716 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.157964 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.158057 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.158295 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.158390 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.158636 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.158746 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.158957 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.159141 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.159861 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.160156 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.160287 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.160478 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.160715 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.160849 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.160972 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.161198 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.161307 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.161521 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.161614 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.161838 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.161990 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.162216 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.162313 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.162442 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.162535 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.162784 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.162896 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.163102 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.163208 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.163412 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.163503 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.163729 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.163818 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.164040 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.164130 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.164364 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.164457 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.164677 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.164776 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.164986 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.165088 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.165297 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.165388 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.165617 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.165710 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.165931 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.166023 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.166243 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.166335 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.166558 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.166663 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.166895 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.166990 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.167218 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.167303 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.167527 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.167608 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.167842 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.167923 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.168238 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.168342 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.168459 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.168543 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.168772 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.168853 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.169089 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.169251 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.169407 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.169499 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.169723 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.169846 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.170039 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.170198 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.170334 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.170449 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.171413 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.171570 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.171704 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.171829 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.171943 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.172054 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.172173 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.172286 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.172416 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.172416 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.172627 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.172737 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.172855 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.172976 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.173102 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.173216 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.173326 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.173444 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.173556 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.173667 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.173787 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.173947 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.174066 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.174255 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.174384 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.174623 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.174758 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.175844 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.176322 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.176454 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.176669 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.176944 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.177065 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.177186 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.177298 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.177420 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.177622 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.177755 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.177941 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.178067 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.178253 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.178358 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.178635 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.178752 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.179034 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.179204 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.179360 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.179520 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.179673 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.179850 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.179986 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.180185 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.180316 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.180517 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.180681 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.180846 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.180940 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.181242 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.181338 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.181580 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.181682 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.181896 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.181997 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.182208 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.182299 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.182528 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.182662 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.182875 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.182966 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.183193 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.183287 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.183509 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.183608 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.183826 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.183926 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.184141 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.184241 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.184450 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.184549 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.184764 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.184855 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.185072 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.185166 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.185385 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.185477 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.185699 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.185790 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.186006 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.186137 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.186316 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.186451 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.186636 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.186728 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.186954 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.187095 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.187267 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.187362 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.187579 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.187670 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.187887 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.188024 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.188198 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.188344 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.188503 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.188602 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.188811 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.188915 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.189149 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.189240 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.189464 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.189555 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.189772 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.189875 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.190084 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.190185 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.190437 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.190551 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.190859 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.190995 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.191173 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.191330 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.191466 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.191555 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.191791 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.192072 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.192167 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.192300 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.192421 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.192629 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.192730 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.192952 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.193051 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.193274 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.193375 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.193590 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.193697 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.193904 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.194223 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.194313 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.194558 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.194746 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.194894 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.194994 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.195209 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.195310 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.195523 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.195623 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.195855 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.195947 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.196173 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.196299 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.196479 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.196593 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.196808 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.196906 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.197130 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.197258 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.197447 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.197551 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.197766 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.197929 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.198086 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.198282 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.198420 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.198555 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.198731 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.198905 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.199042 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.199234 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.199342 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.199565 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.199665 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.199928 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.200027 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.200198 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.200387 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.200515 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.200609 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.200846 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.200992 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.201161 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.201273 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.201479 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.201571 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.201802 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.201929 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.202112 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.202242 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.202424 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.202545 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.202771 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.202891 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.203088 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.203403 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.203717 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.203927 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.204063 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.204286 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.204420 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.204649 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.204775 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.204967 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.205148 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.205280 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.205431 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.205685 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.205802 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.205998 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.206155 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.206371 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.206559 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.206799 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.206925 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.207038 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.207149 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.207339 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.207611 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.207785 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.207905 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.208017 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.208145 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.208282 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.208420 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.208598 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.208700 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.208930 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.209032 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.209268 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.209380 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.209579 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.209679 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.209890 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.209991 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.210207 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.210306 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.210514 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.210662 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.210992 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.211319 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.211654 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.211989 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.212304 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.212632 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.212950 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.213262 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.213574 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.213885 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.214233 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.214546 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.214888 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.215030 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.215257 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.215390 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.215561 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.215683 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.215879 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.215999 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.216218 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.216337 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.216554 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.216680 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.216881 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.217010 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.217201 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.217329 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.217541 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.217853 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.218166 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.218357 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.218477 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.218819 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.218978 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.219128 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.219431 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.219564 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.219748 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.219881 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.220059 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.220206 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.220370 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.220510 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.220681 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.220814 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.221001 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.221147 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.221311 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.221442 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.221635 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.222269 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.222478 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.222741 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.223256 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.223525 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.223706 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.223848 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.224041 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.224204 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.224364 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.224521 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.224685 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.224868 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.224997 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.225202 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.225331 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.225601 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.225761 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.225888 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.226016 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.226172 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.226300 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.226504 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.226659 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.226855 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.226977 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.227177 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.227295 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.227500 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.227624 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.227821 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.228151 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.228471 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.228796 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.229107 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.229429 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.229559 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.229749 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.229869 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.230073 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.230193 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.230495 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.230704 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.230875 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.231003 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.231204 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.231332 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.231538 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.231659 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.231865 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.231983 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.232189 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.232309 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.232515 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.232637 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.232834 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.232959 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.233155 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.233283 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.233474 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.233595 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.233795 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.233915 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.234119 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.234250 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.234447 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.234565 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.234796 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.234922 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.235117 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.235321 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.235438 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.235555 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.235752 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.235879 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.236071 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.236202 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.236390 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.236509 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.236707 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.236823 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.237025 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.237147 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.237349 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.238081 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.238337 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.239239 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.239239 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.239541 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.239668 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.239781 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.239901 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.240013 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.240200 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.240323 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.240520 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.240650 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.240841 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.240981 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.241162 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.241290 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.241483 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.241603 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.241820 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.241950 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.242164 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.242326 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.242488 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.242657 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.242827 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.242961 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.243150 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.243278 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.243471 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.243589 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.244042 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.244361 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.244487 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 18:58:25.244700 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.245033 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.245361 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.245683 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.246166 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.246364 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.246661 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.246975 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.247292 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.247609 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.247920 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.248255 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.248577 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.248884 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.249446 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.249585 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.250069 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.250430 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.250780 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.251120 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.251463 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.251772 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.252107 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.252419 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.252733 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.253113 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.253437 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.253759 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.254066 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.254377 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.254722 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.255039 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.255350 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.255674 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.255979 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.256384 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.256609 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.256921 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.257230 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.257548 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.257860 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.258176 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.258489 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.258867 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.259144 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.259676 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.259837 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.260053 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.260369 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.260678 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.260995 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.261365 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.261702 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.262017 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.262331 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.262683 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.263002 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.263332 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.263650 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.263967 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.264445 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.264694 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.265204 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.265544 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.265867 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.266208 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.266545 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.266893 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.267206 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.267519 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.267850 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.268176 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.268501 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.268874 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.269195 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.269514 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.269894 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.270132 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.270448 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.270791 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.271111 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.271427 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.271766 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.272058 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.272408 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.272732 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.273058 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.273380 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.273700 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.274020 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.274336 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.274674 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.274993 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.275307 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.275629 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.276245 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.276545 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.276858 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.277299 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.277612 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.277940 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.278273 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.278636 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.278937 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.279260 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.279659 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.280197 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.280197 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.280664 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.280914 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.281156 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.281490 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.281801 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.282113 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.282422 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.282821 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.283093 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.283374 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.283683 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.283990 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.284897 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.285281 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.285523 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.286169 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.286169 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.286705 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.286967 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.287194 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.287427 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.287668 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.287928 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.288238 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.288556 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.288870 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.289180 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.289488 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.289796 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.290217 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.290454 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.290792 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.291116 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.291445 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.291765 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.292093 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.292410 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.292882 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.293141 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.293390 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.293683 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.294023 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.294337 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.294676 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.294995 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.295314 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.295632 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.295950 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.296289 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.296620 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.296933 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.297265 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.297588 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.297914 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.298233 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.298551 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.298913 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.299226 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.299541 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.300873 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.301121 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.301351 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.301617 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.301943 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.302284 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.302639 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.303009 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.303294 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.303757 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.304073 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.304397 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.304754 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.305091 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.305413 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.305735 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.306045 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 18:58:25.306295 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 18:58:25.323215 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO dbcounter [None req-0d0b361f-b792-4225-871e-6b6c56ebd6a5 None None] Registered counter for database nova_api Jun 16 18:58:25.348280 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_db.sqlalchemy.engines [None req-0d0b361f-b792-4225-871e-6b6c56ebd6a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117852) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 18:58:25.357468 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writer thread running {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 18:58:25.374071 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO dbcounter [None req-4e51b307-7e52-4867-a23e-f11d0d596f78 None None] Registered counter for database nova_api Jun 16 18:58:25.395331 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_db.sqlalchemy.engines [None req-4e51b307-7e52-4867-a23e-f11d0d596f78 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117850) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 18:58:25.403436 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writer thread running {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 18:58:25.422349 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.context [None req-0d0b361f-b792-4225-871e-6b6c56ebd6a5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1c329222-bcc4-442b-afcb-bc828e5eed9e(cell1) {{(pid=117852) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 18:58:25.427822 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-0d0b361f-b792-4225-871e-6b6c56ebd6a5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:25.429835 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-0d0b361f-b792-4225-871e-6b6c56ebd6a5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:25.430859 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-0d0b361f-b792-4225-871e-6b6c56ebd6a5 None None] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:25.432905 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-0d0b361f-b792-4225-871e-6b6c56ebd6a5 None None] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:25.435033 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO dbcounter [None req-0d0b361f-b792-4225-871e-6b6c56ebd6a5 None None] Registered counter for database nova_cell0 Jun 16 18:58:25.439424 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO dbcounter [None req-0d0b361f-b792-4225-871e-6b6c56ebd6a5 None None] Registered counter for database nova_cell1 Jun 16 18:58:25.447858 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_db.sqlalchemy.engines [None req-0d0b361f-b792-4225-871e-6b6c56ebd6a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117852) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 18:58:25.451382 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_db.sqlalchemy.engines [None req-0d0b361f-b792-4225-871e-6b6c56ebd6a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117852) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 18:58:25.454427 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writer thread running {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 18:58:25.463565 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.context [None req-4e51b307-7e52-4867-a23e-f11d0d596f78 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1c329222-bcc4-442b-afcb-bc828e5eed9e(cell1) {{(pid=117850) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 18:58:25.467770 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-4e51b307-7e52-4867-a23e-f11d0d596f78 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:25.469371 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-4e51b307-7e52-4867-a23e-f11d0d596f78 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:25.470197 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-4e51b307-7e52-4867-a23e-f11d0d596f78 None None] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:58:25.472618 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-4e51b307-7e52-4867-a23e-f11d0d596f78 None None] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:58:25.474771 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO dbcounter [None req-4e51b307-7e52-4867-a23e-f11d0d596f78 None None] Registered counter for database nova_cell0 Jun 16 18:58:25.478776 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO dbcounter [None req-4e51b307-7e52-4867-a23e-f11d0d596f78 None None] Registered counter for database nova_cell1 Jun 16 18:58:25.486531 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_db.sqlalchemy.engines [None req-4e51b307-7e52-4867-a23e-f11d0d596f78 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117850) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 18:58:25.488582 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_db.sqlalchemy.engines [None req-4e51b307-7e52-4867-a23e-f11d0d596f78 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117850) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 18:58:25.495277 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writer thread running {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 18:58:25.497376 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writer thread running {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 18:58:25.599461 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writer thread running {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 18:58:25.612317 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO dbcounter [None req-0d0b361f-b792-4225-871e-6b6c56ebd6a5 None None] Registered counter for database nova_cell0 Jun 16 18:58:25.622664 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_db.sqlalchemy.engines [None req-0d0b361f-b792-4225-871e-6b6c56ebd6a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117852) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 18:58:25.627468 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writer thread running {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 18:58:25.651413 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO dbcounter [None req-4e51b307-7e52-4867-a23e-f11d0d596f78 None None] Registered counter for database nova_cell0 Jun 16 18:58:25.658075 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_db.sqlalchemy.engines [None req-4e51b307-7e52-4867-a23e-f11d0d596f78 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117850) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 18:58:25.662881 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writer thread running {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 18:58:25.989078 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: WARNING keystonemiddleware.auth_token [None req-0d0b361f-b792-4225-871e-6b6c56ebd6a5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 18:58:25.996881 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: WARNING keystonemiddleware.auth_token [None req-0d0b361f-b792-4225-871e-6b6c56ebd6a5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 18:58:26.021077 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: WARNING keystonemiddleware.auth_token [None req-4e51b307-7e52-4867-a23e-f11d0d596f78 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 18:58:26.028774 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: WARNING keystonemiddleware.auth_token [None req-4e51b307-7e52-4867-a23e-f11d0d596f78 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 18:58:26.381806 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: WARNING keystonemiddleware.auth_token [None req-0d0b361f-b792-4225-871e-6b6c56ebd6a5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 18:58:26.387868 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: WARNING keystonemiddleware.auth_token [None req-0d0b361f-b792-4225-871e-6b6c56ebd6a5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 18:58:26.393405 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558c699b79c0 pid: 117852 (default app) Jun 16 18:58:26.407443 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: WARNING keystonemiddleware.auth_token [None req-4e51b307-7e52-4867-a23e-f11d0d596f78 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 18:58:26.414294 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: WARNING keystonemiddleware.auth_token [None req-4e51b307-7e52-4867-a23e-f11d0d596f78 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 18:58:26.419741 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558c699b79c0 pid: 117850 (default app) Jun 16 18:59:06.437059 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_api:SELECT=3 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:06.443914 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_cell0:SELECT=3 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:06.443914 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_cell1:SELECT=3 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:06.443914 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_cell0:SELECT=3 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:07.570907 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-1e7a945f-e359-43af-9343-aa64cfd9bf16 tempest-VolumesGetTestJSON-1050327674 tempest-VolumesGetTestJSON-1050327674-project] Action: 'create', calling method: .version_select at 0x7f12e7d9f790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-609984798", "metadata": {"Type": "work"}}} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:59:09.666225 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-1e7a945f-e359-43af-9343-aa64cfd9bf16 tempest-VolumesGetTestJSON-1050327674 tempest-VolumesGetTestJSON-1050327674-project] 10.222.0.70 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.252866 Jun 16 18:59:09.674727 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 1/1] 10.222.0.70 () {60 vars in 1155 bytes} [Thu Jun 16 18:59:06 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3263 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 16 18:59:10.187135 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-d6acb79b-9ebd-40b4-96b7-9ed8a62d6b2c tempest-VolumesGetTestJSON-1050327674 tempest-VolumesGetTestJSON-1050327674-project] Calling method '.version_select at 0x7f12e87a59d0>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:10.260327 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_api:SELECT=3 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:10.262239 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_cell0:SELECT=3 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:10.263529 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_cell1:SELECT=3 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:10.265462 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_cell0:SELECT=3 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:11.195725 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-d6acb79b-9ebd-40b4-96b7-9ed8a62d6b2c tempest-VolumesGetTestJSON-1050327674 tempest-VolumesGetTestJSON-1050327674-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/5bef1fc8-2959-4f77-ab2b-9fc521e62137" status: 200 len: 353 microversion: 2.1 time: 1.517471 Jun 16 18:59:11.197330 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 1/2] 10.222.0.70 () {58 vars in 1244 bytes} [Thu Jun 16 18:59:09 2022] GET /compute/v2.1/os-volumes/5bef1fc8-2959-4f77-ab2b-9fc521e62137 => generated 353 bytes in 1522 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:59:11.209244 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-a459b617-babc-495e-937f-61eb458834f1 tempest-VolumesGetTestJSON-1050327674 tempest-VolumesGetTestJSON-1050327674-project] Calling method '.version_select at 0x7f12e7c695e0>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:11.446556 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-a459b617-babc-495e-937f-61eb458834f1 tempest-VolumesGetTestJSON-1050327674 tempest-VolumesGetTestJSON-1050327674-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/5bef1fc8-2959-4f77-ab2b-9fc521e62137" status: 200 len: 353 microversion: 2.1 time: 0.241605 Jun 16 18:59:11.447349 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 2/3] 10.222.0.70 () {58 vars in 1244 bytes} [Thu Jun 16 18:59:11 2022] GET /compute/v2.1/os-volumes/5bef1fc8-2959-4f77-ab2b-9fc521e62137 => generated 353 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:59:11.461427 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-a6ac769b-4336-4096-b8c8-b9e82d2e15eb tempest-VolumesGetTestJSON-1050327674 tempest-VolumesGetTestJSON-1050327674-project] Calling method '.version_select at 0x7f12e7cab670>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:12.009083 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-a6ac769b-4336-4096-b8c8-b9e82d2e15eb tempest-VolumesGetTestJSON-1050327674 tempest-VolumesGetTestJSON-1050327674-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/5bef1fc8-2959-4f77-ab2b-9fc521e62137" status: 202 len: 0 microversion: 2.1 time: 0.552721 Jun 16 18:59:12.010659 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 2/4] 10.222.0.70 () {58 vars in 1247 bytes} [Thu Jun 16 18:59:11 2022] DELETE /compute/v2.1/os-volumes/5bef1fc8-2959-4f77-ab2b-9fc521e62137 => generated 0 bytes in 556 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 18:59:12.019372 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-f93edde8-c2ec-454f-aa5e-4e5c8903ae26 tempest-VolumesGetTestJSON-1050327674 tempest-VolumesGetTestJSON-1050327674-project] Calling method '.version_select at 0x7f12e7c69820>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:12.250816 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-f93edde8-c2ec-454f-aa5e-4e5c8903ae26 tempest-VolumesGetTestJSON-1050327674 tempest-VolumesGetTestJSON-1050327674-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/5bef1fc8-2959-4f77-ab2b-9fc521e62137" status: 200 len: 352 microversion: 2.1 time: 0.236058 Jun 16 18:59:12.252289 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 3/5] 10.222.0.70 () {58 vars in 1244 bytes} [Thu Jun 16 18:59:12 2022] GET /compute/v2.1/os-volumes/5bef1fc8-2959-4f77-ab2b-9fc521e62137 => generated 352 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:59:13.264537 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-df0a3ad5-c13d-4967-9911-d028ec0ea476 tempest-VolumesGetTestJSON-1050327674 tempest-VolumesGetTestJSON-1050327674-project] Calling method '.version_select at 0x7f12e7cab700>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:13.347488 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.wsgi [None req-df0a3ad5-c13d-4967-9911-d028ec0ea476 tempest-VolumesGetTestJSON-1050327674 tempest-VolumesGetTestJSON-1050327674-project] HTTP exception thrown: Volume 5bef1fc8-2959-4f77-ab2b-9fc521e62137 could not be found. Jun 16 18:59:13.353164 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-df0a3ad5-c13d-4967-9911-d028ec0ea476 tempest-VolumesGetTestJSON-1050327674 tempest-VolumesGetTestJSON-1050327674-project] Request method failure captured: Jun 16 18:59:13.353164 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: request: GET /compute/v2.1/os-volumes/5bef1fc8-2959-4f77-ab2b-9fc521e62137 HTTP/1.1 Jun 16 18:59:13.353164 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Accept: application/json Jun 16 18:59:13.353164 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Accept-Encoding: identity Jun 16 18:59:13.353164 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Connection: close Jun 16 18:59:13.353164 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Content-Length: 0 Jun 16 18:59:13.353164 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Content-Type: application/json Jun 16 18:59:13.353164 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Host: 10.222.0.70 Jun 16 18:59:13.353164 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Openstack-System-Scope: None Jun 16 18:59:13.353164 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: User-Agent: python-urllib3/1.26.9 Jun 16 18:59:13.353164 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Auth-Token: gAAAAABiq316xawiNCntsKjGQVofttl6skZsKBkPnZBpUrLWKRj3GGdgd5snRYYLjfLoMyvB__XD-yCRVnu-6mbs0RhpojsRKvK_Yrmx5asRPdvm0B9QcgsEu97huBbGfM2DGE4l52V63MmneQOFi-ev0MvrPnsbyFHqaDFotUSMXkufyE6fxzE Jun 16 18:59:13.353164 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Domain-Id: None Jun 16 18:59:13.353164 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Domain-Name: None Jun 16 18:59:13.353164 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Identity-Status: Confirmed Jun 16 18:59:13.353164 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Is-Admin-Project: True Jun 16 18:59:13.353164 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Domain-Id: default Jun 16 18:59:13.353164 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Domain-Name: Default Jun 16 18:59:13.353164 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Id: cfa78ac31e2d4894a8855c57206e67ce Jun 16 18:59:13.353164 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Name: tempest-VolumesGetTestJSON-1050327674 Jun 16 18:59:13.353164 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Role: member,reader Jun 16 18:59:13.353164 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Roles: member,reader Jun 16 18:59:13.354855 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cfa78ac31e2d4894a8855c57206e67ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_cfa78ac31e2d4894a8855c57206e67ce", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/cfa78ac31e2d4894a8855c57206e67ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cfa78ac31e2d4894a8855c57206e67ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 16 18:59:13.354855 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant: tempest-VolumesGetTestJSON-1050327674 Jun 16 18:59:13.354855 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant-Id: cfa78ac31e2d4894a8855c57206e67ce Jun 16 18:59:13.354855 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant-Name: tempest-VolumesGetTestJSON-1050327674 Jun 16 18:59:13.354855 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User: tempest-VolumesGetTestJSON-1050327674-project Jun 16 18:59:13.354855 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Domain-Id: default Jun 16 18:59:13.354855 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Domain-Name: Default Jun 16 18:59:13.354855 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Id: 9c78775627eb48ee9ef35b0b43d5643a Jun 16 18:59:13.354855 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Name: tempest-VolumesGetTestJSON-1050327674-project Jun 16 18:59:13.354855 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: method: Jun 16 18:59:13.354855 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: exception: Volume 5bef1fc8-2959-4f77-ab2b-9fc521e62137 could not be found. Jun 16 18:59:13.354855 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: action_args: {'id': '5bef1fc8-2959-4f77-ab2b-9fc521e62137'} Jun 16 18:59:13.354855 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 18:59:13.355858 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:59:13.355858 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 18:59:13.355858 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 18:59:13.355858 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 18:59:13.355858 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 18:59:13.355858 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 18:59:13.355858 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 18:59:13.355858 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 18:59:13.355858 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 18:59:13.355858 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 18:59:13.355858 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 18:59:13.355858 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 18:59:13.355858 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 18:59:13.355858 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 18:59:13.355858 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 18:59:13.355858 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5bef1fc8-2959-4f77-ab2b-9fc521e62137 could not be found. (HTTP 404) (Request-ID: req-e6e69460-da8e-49a6-abda-eaf2c98a4d65) Jun 16 18:59:13.355858 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 18:59:13.355858 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:59:13.355858 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 18:59:13.357256 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:59:13.357256 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 18:59:13.357256 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 18:59:13.357256 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 18:59:13.357256 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 18:59:13.357256 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 18:59:13.357256 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 18:59:13.357256 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 18:59:13.357256 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 18:59:13.357256 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 18:59:13.357256 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 18:59:13.357256 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 18:59:13.357256 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 18:59:13.357256 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 18:59:13.357256 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 18:59:13.357256 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 18:59:13.357256 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 18:59:13.357256 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 18:59:13.357256 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 18:59:13.359080 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 18:59:13.359080 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 18:59:13.359080 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 18:59:13.359080 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 18:59:13.359080 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5bef1fc8-2959-4f77-ab2b-9fc521e62137 could not be found. Jun 16 18:59:13.359080 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 18:59:13.359080 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:59:13.359080 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 18:59:13.359080 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:59:13.359080 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:59:13.359080 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:59:13.359080 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 18:59:13.359080 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 18:59:13.359080 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 18:59:13.359080 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 18:59:13.359080 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 18:59:13.359080 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 18:59:13.359080 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 18:59:13.359080 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 18:59:13.360497 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5bef1fc8-2959-4f77-ab2b-9fc521e62137 could not be found. Jun 16 18:59:13.360497 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 18:59:13.360497 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 18:59:13.360497 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 18:59:13.360497 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 18:59:13.360497 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 18:59:13.360497 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 18:59:13.360497 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 18:59:13.360497 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 18:59:13.360497 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5bef1fc8-2959-4f77-ab2b-9fc521e62137 could not be found. Jun 16 18:59:13.360497 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 18:59:13.360497 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-df0a3ad5-c13d-4967-9911-d028ec0ea476 tempest-VolumesGetTestJSON-1050327674 tempest-VolumesGetTestJSON-1050327674-project] Returning 404 to user: Volume 5bef1fc8-2959-4f77-ab2b-9fc521e62137 could not be found. {{(pid=117850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 18:59:13.360497 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-df0a3ad5-c13d-4967-9911-d028ec0ea476 tempest-VolumesGetTestJSON-1050327674 tempest-VolumesGetTestJSON-1050327674-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/5bef1fc8-2959-4f77-ab2b-9fc521e62137" status: 404 len: 109 microversion: 2.1 time: 0.095635 Jun 16 18:59:13.363616 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 3/6] 10.222.0.70 () {58 vars in 1244 bytes} [Thu Jun 16 18:59:13 2022] GET /compute/v2.1/os-volumes/5bef1fc8-2959-4f77-ab2b-9fc521e62137 => generated 109 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 18:59:21.211327 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-1d84e121-3b9d-4f36-9178-085dc1fb8d55 tempest-VolumesTestJSON-2124703965 tempest-VolumesTestJSON-2124703965-project] Calling method '.version_select at 0x7f12e7c69d30>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:21.476767 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-1d84e121-3b9d-4f36-9178-085dc1fb8d55 tempest-VolumesTestJSON-2124703965 tempest-VolumesTestJSON-2124703965-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/29117970-11b7-4dfd-89e3-2879ce04a653" status: 200 len: 351 microversion: 2.1 time: 0.269199 Jun 16 18:59:21.478968 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 4/7] 10.222.0.70 () {58 vars in 1244 bytes} [Thu Jun 16 18:59:21 2022] GET /compute/v2.1/os-volumes/29117970-11b7-4dfd-89e3-2879ce04a653 => generated 351 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:59:23.211901 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-9210be11-33b9-4962-8924-b70ad40a659b tempest-VolumesTestJSON-2124703965 tempest-VolumesTestJSON-2124703965-project] Calling method '.version_select at 0x7f12e864bc10>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:23.335377 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-9210be11-33b9-4962-8924-b70ad40a659b tempest-VolumesTestJSON-2124703965 tempest-VolumesTestJSON-2124703965-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/dd7aa817-943a-45ea-97e8-839c9086f961" status: 200 len: 351 microversion: 2.1 time: 0.128394 Jun 16 18:59:23.335935 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 4/8] 10.222.0.70 () {58 vars in 1244 bytes} [Thu Jun 16 18:59:23 2022] GET /compute/v2.1/os-volumes/dd7aa817-943a-45ea-97e8-839c9086f961 => generated 351 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:59:25.335134 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-a42ca05c-968d-452e-895a-9e7b3c7109c9 tempest-VolumesTestJSON-2124703965 tempest-VolumesTestJSON-2124703965-project] Calling method '.version_select at 0x7f12e7cab940>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:25.464253 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-a42ca05c-968d-452e-895a-9e7b3c7109c9 tempest-VolumesTestJSON-2124703965 tempest-VolumesTestJSON-2124703965-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/0dd78b65-54ac-4095-a2cb-3a447893a4b4" status: 200 len: 350 microversion: 2.1 time: 0.135533 Jun 16 18:59:25.466829 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 5/9] 10.222.0.70 () {58 vars in 1244 bytes} [Thu Jun 16 18:59:25 2022] GET /compute/v2.1/os-volumes/0dd78b65-54ac-4095-a2cb-3a447893a4b4 => generated 350 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:59:25.480681 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-cfcf92ff-a5a4-4e35-8860-c6abb0ac62a1 tempest-VolumesTestJSON-2124703965 tempest-VolumesTestJSON-2124703965-project] Calling method '.version_select at 0x7f12e7bd45e0>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:25.698864 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-cfcf92ff-a5a4-4e35-8860-c6abb0ac62a1 tempest-VolumesTestJSON-2124703965 tempest-VolumesTestJSON-2124703965-project] 10.222.0.70 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.221937 Jun 16 18:59:25.699670 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 6/10] 10.222.0.70 () {58 vars in 1133 bytes} [Thu Jun 16 18:59:25 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:25.852358 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-fd725b9f-ca17-4500-882d-e7df3a0f59b0 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-46173299", "imageRef": "1d993e69-7f01-4fe0-ba52-0eae2fa43ddf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:59:26.088023 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-0e230049-eeb9-4950-aa94-1cd277862169 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1700610446", "imageRef": "1d993e69-7f01-4fe0-ba52-0eae2fa43ddf", "flavorRef": "452", "networks": [{"uuid": "8f90b86e-ffe8-498b-a693-e28409deb045"}]}} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:59:26.214653 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.network.neutron [None req-fd725b9f-ca17-4500-882d-e7df3a0f59b0 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] validate_networks() for [('f41d193c-78d1-4108-9995-cf5c5eb8fc37', None, None, None, None, None)] {{(pid=117852) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:59:26.570165 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.network.neutron [None req-0e230049-eeb9-4950-aa94-1cd277862169 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] validate_networks() for [('8f90b86e-ffe8-498b-a693-e28409deb045', None, None, None, None, None)] {{(pid=117850) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:59:28.858489 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.virt.hardware [None req-fd725b9f-ca17-4500-882d-e7df3a0f59b0 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Flavor limits 0:0:0 {{(pid=117852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:59:28.861219 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.virt.hardware [None req-fd725b9f-ca17-4500-882d-e7df3a0f59b0 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Image limits 0:0:0 {{(pid=117852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:59:28.867720 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.virt.hardware [None req-fd725b9f-ca17-4500-882d-e7df3a0f59b0 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Flavor pref 0:0:0 {{(pid=117852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:59:28.876268 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.virt.hardware [None req-fd725b9f-ca17-4500-882d-e7df3a0f59b0 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Image pref 0:0:0 {{(pid=117852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:59:28.877247 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.virt.hardware [None req-fd725b9f-ca17-4500-882d-e7df3a0f59b0 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:59:28.898892 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-fd725b9f-ca17-4500-882d-e7df3a0f59b0 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:28.899362 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-fd725b9f-ca17-4500-882d-e7df3a0f59b0 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:28.900176 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-fd725b9f-ca17-4500-882d-e7df3a0f59b0 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:28.900611 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-fd725b9f-ca17-4500-882d-e7df3a0f59b0 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:29.045185 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.quota [None req-fd725b9f-ca17-4500-882d-e7df3a0f59b0 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Getting quotas for project 83b304be7bd84301b898bb50f4ac7ae4. Resources: {'cores', 'ram', 'instances'} {{(pid=117852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:59:29.080420 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.quota [None req-fd725b9f-ca17-4500-882d-e7df3a0f59b0 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Getting quotas for user 7f703f74c7ff43a291f54103e164ccdf and project 83b304be7bd84301b898bb50f4ac7ae4. Resources: {'cores', 'ram', 'instances'} {{(pid=117852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:59:29.106344 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-fd725b9f-ca17-4500-882d-e7df3a0f59b0 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Going to run 1 instances... {{(pid=117852) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:59:29.116664 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-fd725b9f-ca17-4500-882d-e7df3a0f59b0 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1407f346-2c64-41d0-b983-268e60273230] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1d993e69-7f01-4fe0-ba52-0eae2fa43ddf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117852) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:59:29.278695 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-fd725b9f-ca17-4500-882d-e7df3a0f59b0 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.109339 Jun 16 18:59:29.279629 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 5/11] 10.222.0.70 () {60 vars in 1146 bytes} [Thu Jun 16 18:59:25 2022] POST /compute/v2.1/servers => generated 383 bytes in 4111 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:59:29.292098 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-2309fd85-5f7b-4665-8e37-c5f40bba8be6 tempest-VolumesTestJSON-2124703965 tempest-VolumesTestJSON-2124703965-project] Calling method '.version_select at 0x7f12e6b0e0d0>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:29.363856 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-0e230049-eeb9-4950-aa94-1cd277862169 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Flavor limits 0:0:0 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:59:29.366676 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-0e230049-eeb9-4950-aa94-1cd277862169 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Image limits 0:0:0 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:59:29.368410 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-0e230049-eeb9-4950-aa94-1cd277862169 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Flavor pref 0:0:0 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:59:29.369029 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-0e230049-eeb9-4950-aa94-1cd277862169 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Image pref 0:0:0 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:59:29.369807 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-0e230049-eeb9-4950-aa94-1cd277862169 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:59:29.410936 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0e230049-eeb9-4950-aa94-1cd277862169 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:29.411352 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0e230049-eeb9-4950-aa94-1cd277862169 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:29.412171 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0e230049-eeb9-4950-aa94-1cd277862169 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:29.412607 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0e230049-eeb9-4950-aa94-1cd277862169 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:29.514791 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.quota [None req-0e230049-eeb9-4950-aa94-1cd277862169 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Getting quotas for project 7de0652519d3447b8d0e4d948610071f. Resources: {'cores', 'ram', 'instances'} {{(pid=117850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:59:29.546654 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.quota [None req-0e230049-eeb9-4950-aa94-1cd277862169 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Getting quotas for user e8813b3f6f8c46519fb827cf521bb37b and project 7de0652519d3447b8d0e4d948610071f. Resources: {'cores', 'ram', 'instances'} {{(pid=117850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:59:29.593516 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-0e230049-eeb9-4950-aa94-1cd277862169 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Going to run 1 instances... {{(pid=117850) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:59:29.603861 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-0e230049-eeb9-4950-aa94-1cd277862169 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] [instance: de7eb4c7-a555-44f0-84c2-428b23b31a2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1d993e69-7f01-4fe0-ba52-0eae2fa43ddf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:59:29.609218 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-2309fd85-5f7b-4665-8e37-c5f40bba8be6 tempest-VolumesTestJSON-2124703965 tempest-VolumesTestJSON-2124703965-project] 10.222.0.70 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.328227 Jun 16 18:59:29.610795 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 6/12] 10.222.0.70 () {58 vars in 1148 bytes} [Thu Jun 16 18:59:29 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:59:29.770488 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-0e230049-eeb9-4950-aa94-1cd277862169 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.069473 Jun 16 18:59:29.780133 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 7/13] 10.222.0.70 () {60 vars in 1146 bytes} [Thu Jun 16 18:59:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 4080 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:59:29.793894 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-73f266c1-74a7-4103-998c-a0fc21c2c3c1 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:29.795326 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-73f266c1-74a7-4103-998c-a0fc21c2c3c1 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1407f346-2c64-41d0-b983-268e60273230] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:30.000374 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-73f266c1-74a7-4103-998c-a0fc21c2c3c1 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:30.034996 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-73f266c1-74a7-4103-998c-a0fc21c2c3c1 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1407f346-2c64-41d0-b983-268e60273230" status: 200 len: 1220 microversion: 2.1 time: 0.253013 Jun 16 18:59:30.037218 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 8/14] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:29 2022] GET /compute/v2.1/servers/1407f346-2c64-41d0-b983-268e60273230 => generated 1220 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:30.046023 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-15294579-b5fb-4d77-8c6e-8265de8c23a8 tempest-VolumesTestJSON-2124703965 tempest-VolumesTestJSON-2124703965-project] Calling method '.version_select at 0x7f12e72f6820>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:30.132037 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-07cb552e-bac8-40db-b92c-2a41a46f8a7e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Action: 'create', calling method: .version_select at 0x7f12e6b0ed30>, body: {"keypair": {"name": "tempest-keypair-170023621", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGHROyu1zAugUVxIm1QgWXjm4g8EAMZDMX0uca6KhdtbIKUHvh0Zq26bPNP/QJs2FiJaebbn/Kc3s8c36Gs57Is0KyqyIrImLCmC+yHOri2zbD/hdUoWwS2++/cJspSuvQ=="}} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:59:30.173742 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.quota [None req-07cb552e-bac8-40db-b92c-2a41a46f8a7e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Getting quotas for project 057aef18c52b49a382450331694c04d6. Resources: {'key_pairs'} {{(pid=117852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:59:30.179617 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.quota [None req-07cb552e-bac8-40db-b92c-2a41a46f8a7e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Getting quotas for user 04327f3d7b844ddb88cf4a81145634c4 and project 057aef18c52b49a382450331694c04d6. Resources: {'key_pairs'} {{(pid=117852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:59:30.269032 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-07cb552e-bac8-40db-b92c-2a41a46f8a7e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.656497 Jun 16 18:59:30.277722 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 7/15] 10.222.0.70 () {62 vars in 1199 bytes} [Thu Jun 16 18:59:29 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 666 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 16 18:59:30.290153 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-d9d0a95f-6c3b-4447-9c7c-3b5bda2c68b8 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:30.290991 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-d9d0a95f-6c3b-4447-9c7c-3b5bda2c68b8 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] [instance: de7eb4c7-a555-44f0-84c2-428b23b31a2d] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:30.357222 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-15294579-b5fb-4d77-8c6e-8265de8c23a8 tempest-VolumesTestJSON-2124703965 tempest-VolumesTestJSON-2124703965-project] 10.222.0.70 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.317448 Jun 16 18:59:30.357968 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 9/16] 10.222.0.70 () {58 vars in 1133 bytes} [Thu Jun 16 18:59:30 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:30.372243 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-b552f1fc-b2f3-43fa-a082-c6a325a20f5e tempest-VolumesTestJSON-2124703965 tempest-VolumesTestJSON-2124703965-project] Calling method '.version_select at 0x7f12e72f6430>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:30.698079 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-d9d0a95f-6c3b-4447-9c7c-3b5bda2c68b8 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8813b3f6f8c46519fb827cf521bb37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de0652519d3447b8d0e4d948610071f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:30.777038 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-d9d0a95f-6c3b-4447-9c7c-3b5bda2c68b8 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] 10.222.0.70 "GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d" status: 200 len: 1215 microversion: 2.1 time: 0.478220 Jun 16 18:59:30.784596 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 8/17] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:30 2022] GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d => generated 1215 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:30.796095 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-b552f1fc-b2f3-43fa-a082-c6a325a20f5e tempest-VolumesTestJSON-2124703965 tempest-VolumesTestJSON-2124703965-project] 10.222.0.70 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.427949 Jun 16 18:59:30.796676 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 10/18] 10.222.0.70 () {58 vars in 1166 bytes} [Thu Jun 16 18:59:30 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:59:30.810559 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-39622b07-f442-45ec-8c00-b42bae0184fe tempest-VolumesTestJSON-2124703965 tempest-VolumesTestJSON-2124703965-project] Calling method '.version_select at 0x7f12e6a9c040>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:31.312814 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-39622b07-f442-45ec-8c00-b42bae0184fe tempest-VolumesTestJSON-2124703965 tempest-VolumesTestJSON-2124703965-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.506214 Jun 16 18:59:31.313632 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 11/19] 10.222.0.70 () {58 vars in 1169 bytes} [Thu Jun 16 18:59:30 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:59:31.330400 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-3bda62a9-8fce-4b8b-8d87-eccff2eb719a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1267051282", "imageRef": "1d993e69-7f01-4fe0-ba52-0eae2fa43ddf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:59:31.534142 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-0029353b-ca78-48f9-9a3e-c52ec39a1c57 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Action: 'create', calling method: .version_select at 0x7f12e62e2e50>, body: {"keypair": {"name": "tempest-keypair-644366971", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFh6KEgQHGCEeur0VOQpHdkEl1v5pEu/T4kCOj8hh8rp5hQG8jgmgwTJP5eZovPfDY9tGIyg3fp5bAJHO/syLNYruZx2jpXAD5OjWQdo2x1EE0uhxcHTULwpp61GXYdFug=="}} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:59:31.571917 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.network.neutron [None req-3bda62a9-8fce-4b8b-8d87-eccff2eb719a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] validate_networks() for [('f41d193c-78d1-4108-9995-cf5c5eb8fc37', None, None, None, None, None)] {{(pid=117850) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:59:31.591011 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.quota [None req-0029353b-ca78-48f9-9a3e-c52ec39a1c57 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Getting quotas for project d865cf7b3e5c4291a0204f396143083a. Resources: {'key_pairs'} {{(pid=117852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:59:31.618251 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.quota [None req-0029353b-ca78-48f9-9a3e-c52ec39a1c57 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Getting quotas for user 8742a73e9b4f46deb0b5c9e1756ffe2e and project d865cf7b3e5c4291a0204f396143083a. Resources: {'key_pairs'} {{(pid=117852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:59:31.652079 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-0029353b-ca78-48f9-9a3e-c52ec39a1c57 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.863104 Jun 16 18:59:31.653676 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 9/20] 10.222.0.70 () {60 vars in 1158 bytes} [Thu Jun 16 18:59:30 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:59:31.661521 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-1aec858d-1d40-4506-865e-bbb70829b2c0 tempest-VolumesTestJSON-2124703965 tempest-VolumesTestJSON-2124703965-project] Calling method '.version_select at 0x7f12e62ec820>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:31.796964 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-1aec858d-1d40-4506-865e-bbb70829b2c0 tempest-VolumesTestJSON-2124703965 tempest-VolumesTestJSON-2124703965-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.141631 Jun 16 18:59:31.798363 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 10/21] 10.222.0.70 () {58 vars in 1154 bytes} [Thu Jun 16 18:59:31 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:31.820877 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-7307bf44-6014-4a6a-ba3a-e65a4884d5ef tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:31.823229 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-7307bf44-6014-4a6a-ba3a-e65a4884d5ef tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] [instance: de7eb4c7-a555-44f0-84c2-428b23b31a2d] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:32.091399 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-7307bf44-6014-4a6a-ba3a-e65a4884d5ef tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8813b3f6f8c46519fb827cf521bb37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de0652519d3447b8d0e4d948610071f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:32.104008 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-7307bf44-6014-4a6a-ba3a-e65a4884d5ef tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] 10.222.0.70 "GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d" status: 200 len: 1215 microversion: 2.1 time: 0.303569 Jun 16 18:59:32.104803 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 11/22] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:31 2022] GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d => generated 1215 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:32.119854 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-81d89d64-3fe3-45c6-aed8-bcef35d0938d tempest-VolumesTestJSON-2124703965 tempest-VolumesTestJSON-2124703965-project] Calling method '.version_select at 0x7f12e62f01f0>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:32.290123 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-81d89d64-3fe3-45c6-aed8-bcef35d0938d tempest-VolumesTestJSON-2124703965 tempest-VolumesTestJSON-2124703965-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.174569 Jun 16 18:59:32.290736 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 12/23] 10.222.0.70 () {58 vars in 1187 bytes} [Thu Jun 16 18:59:32 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:59:32.304813 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-0af85fe8-cfd4-49ae-a422-c2a779031075 tempest-VolumesTestJSON-2124703965 tempest-VolumesTestJSON-2124703965-project] Calling method '.version_select at 0x7f12e62ec670>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:32.810214 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-0af85fe8-cfd4-49ae-a422-c2a779031075 tempest-VolumesTestJSON-2124703965 tempest-VolumesTestJSON-2124703965-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.509286 Jun 16 18:59:32.811126 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 13/24] 10.222.0.70 () {58 vars in 1154 bytes} [Thu Jun 16 18:59:32 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:33.123306 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-ae875f48-1a7c-496d-9859-d6de69e33ae4 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:33.123975 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-ae875f48-1a7c-496d-9859-d6de69e33ae4 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] [instance: de7eb4c7-a555-44f0-84c2-428b23b31a2d] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:33.155165 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ae875f48-1a7c-496d-9859-d6de69e33ae4 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:33.155634 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ae875f48-1a7c-496d-9859-d6de69e33ae4 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:33.156488 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ae875f48-1a7c-496d-9859-d6de69e33ae4 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:33.163704 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ae875f48-1a7c-496d-9859-d6de69e33ae4 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:33.378023 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-3bda62a9-8fce-4b8b-8d87-eccff2eb719a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Flavor limits 0:0:0 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:59:33.379301 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-3bda62a9-8fce-4b8b-8d87-eccff2eb719a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Image limits 0:0:0 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:59:33.380362 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-3bda62a9-8fce-4b8b-8d87-eccff2eb719a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Flavor pref 0:0:0 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:59:33.380995 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-3bda62a9-8fce-4b8b-8d87-eccff2eb719a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Image pref 0:0:0 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:59:33.381689 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-3bda62a9-8fce-4b8b-8d87-eccff2eb719a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:59:33.427075 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-3bda62a9-8fce-4b8b-8d87-eccff2eb719a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:33.427075 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-3bda62a9-8fce-4b8b-8d87-eccff2eb719a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:33.430789 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-3bda62a9-8fce-4b8b-8d87-eccff2eb719a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:33.431505 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-3bda62a9-8fce-4b8b-8d87-eccff2eb719a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:33.541307 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.quota [None req-3bda62a9-8fce-4b8b-8d87-eccff2eb719a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Getting quotas for project 83b304be7bd84301b898bb50f4ac7ae4. Resources: {'cores', 'ram', 'instances'} {{(pid=117850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:59:33.566692 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.quota [None req-3bda62a9-8fce-4b8b-8d87-eccff2eb719a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Getting quotas for user 7f703f74c7ff43a291f54103e164ccdf and project 83b304be7bd84301b898bb50f4ac7ae4. Resources: {'cores', 'ram', 'instances'} {{(pid=117850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:59:33.616723 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-3bda62a9-8fce-4b8b-8d87-eccff2eb719a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Going to run 1 instances... {{(pid=117850) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:59:33.628547 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-3bda62a9-8fce-4b8b-8d87-eccff2eb719a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1e6f9976-8df1-4719-a873-ab83b056f95e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1d993e69-7f01-4fe0-ba52-0eae2fa43ddf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:59:33.830104 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-3bda62a9-8fce-4b8b-8d87-eccff2eb719a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.512494 Jun 16 18:59:33.832258 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 12/25] 10.222.0.70 () {60 vars in 1146 bytes} [Thu Jun 16 18:59:31 2022] POST /compute/v2.1/servers => generated 383 bytes in 2518 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:59:33.848785 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-311fadde-4877-40ab-878e-dd33a34795df tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:33.849409 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-311fadde-4877-40ab-878e-dd33a34795df tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1e6f9976-8df1-4719-a873-ab83b056f95e] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:33.896348 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-ae875f48-1a7c-496d-9859-d6de69e33ae4 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8813b3f6f8c46519fb827cf521bb37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de0652519d3447b8d0e4d948610071f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:33.929536 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-ae875f48-1a7c-496d-9859-d6de69e33ae4 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] 10.222.0.70 "GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d" status: 200 len: 1211 microversion: 2.1 time: 0.810843 Jun 16 18:59:33.934681 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 14/26] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:33 2022] GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d => generated 1211 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:34.115669 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-311fadde-4877-40ab-878e-dd33a34795df tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:34.128597 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-311fadde-4877-40ab-878e-dd33a34795df tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e" status: 200 len: 1222 microversion: 2.1 time: 0.284059 Jun 16 18:59:34.143371 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 13/27] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:33 2022] GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e => generated 1222 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:34.947629 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-e3d20d33-6e5c-42c9-9452-6d5152d90b6a tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:34.949202 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-e3d20d33-6e5c-42c9-9452-6d5152d90b6a tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] [instance: de7eb4c7-a555-44f0-84c2-428b23b31a2d] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:34.964715 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-e3d20d33-6e5c-42c9-9452-6d5152d90b6a tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:34.965434 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-e3d20d33-6e5c-42c9-9452-6d5152d90b6a tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:34.967165 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-e3d20d33-6e5c-42c9-9452-6d5152d90b6a tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:34.969246 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-e3d20d33-6e5c-42c9-9452-6d5152d90b6a tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:35.161774 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-3e28c0c9-fcc6-412a-acc3-7ad0714eb9ba tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:35.167559 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-3e28c0c9-fcc6-412a-acc3-7ad0714eb9ba tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1e6f9976-8df1-4719-a873-ab83b056f95e] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:35.184792 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-3e28c0c9-fcc6-412a-acc3-7ad0714eb9ba tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:35.190314 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-3e28c0c9-fcc6-412a-acc3-7ad0714eb9ba tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:35.197310 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-3e28c0c9-fcc6-412a-acc3-7ad0714eb9ba tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:35.198144 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-3e28c0c9-fcc6-412a-acc3-7ad0714eb9ba tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:35.634203 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-3e28c0c9-fcc6-412a-acc3-7ad0714eb9ba tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:35.654384 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-3e28c0c9-fcc6-412a-acc3-7ad0714eb9ba tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e" status: 200 len: 1218 microversion: 2.1 time: 0.509076 Jun 16 18:59:35.660788 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 14/28] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:35 2022] GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e => generated 1218 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:35.666601 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-e3d20d33-6e5c-42c9-9452-6d5152d90b6a tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8813b3f6f8c46519fb827cf521bb37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de0652519d3447b8d0e4d948610071f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:35.678908 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-e3d20d33-6e5c-42c9-9452-6d5152d90b6a tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] 10.222.0.70 "GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d" status: 200 len: 1273 microversion: 2.1 time: 0.735171 Jun 16 18:59:35.689981 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 15/29] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:34 2022] GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d => generated 1273 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:36.676498 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-e58d3402-336b-419e-9434-6641f75e766c tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:36.677298 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-e58d3402-336b-419e-9434-6641f75e766c tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1e6f9976-8df1-4719-a873-ab83b056f95e] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:36.700045 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-f9cbab36-7c0e-42c4-a727-3013e216f3db tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:36.700837 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-f9cbab36-7c0e-42c4-a727-3013e216f3db tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] [instance: de7eb4c7-a555-44f0-84c2-428b23b31a2d] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:36.705738 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-e58d3402-336b-419e-9434-6641f75e766c tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:36.713727 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-e58d3402-336b-419e-9434-6641f75e766c tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:36.715425 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-e58d3402-336b-419e-9434-6641f75e766c tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:36.722233 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-e58d3402-336b-419e-9434-6641f75e766c tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:36.722904 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f9cbab36-7c0e-42c4-a727-3013e216f3db tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:36.726291 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f9cbab36-7c0e-42c4-a727-3013e216f3db tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:36.733667 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f9cbab36-7c0e-42c4-a727-3013e216f3db tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:36.738664 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f9cbab36-7c0e-42c4-a727-3013e216f3db tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:37.542343 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-f9cbab36-7c0e-42c4-a727-3013e216f3db tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8813b3f6f8c46519fb827cf521bb37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de0652519d3447b8d0e4d948610071f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:37.553059 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-f9cbab36-7c0e-42c4-a727-3013e216f3db tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] 10.222.0.70 "GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d" status: 200 len: 1273 microversion: 2.1 time: 0.856817 Jun 16 18:59:37.553969 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 16/30] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:36 2022] GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d => generated 1273 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:59:38.079912 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-e58d3402-336b-419e-9434-6641f75e766c tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:38.090011 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-e58d3402-336b-419e-9434-6641f75e766c tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e" status: 200 len: 1292 microversion: 2.1 time: 1.416140 Jun 16 18:59:38.091297 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 15/31] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:36 2022] GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e => generated 1292 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:38.570326 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-963aba13-61d6-4d0e-8d9f-32744c01492c tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:38.571736 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-963aba13-61d6-4d0e-8d9f-32744c01492c tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] [instance: de7eb4c7-a555-44f0-84c2-428b23b31a2d] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:38.583562 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-963aba13-61d6-4d0e-8d9f-32744c01492c tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:38.588726 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-963aba13-61d6-4d0e-8d9f-32744c01492c tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:38.592288 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-963aba13-61d6-4d0e-8d9f-32744c01492c tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:38.597846 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-963aba13-61d6-4d0e-8d9f-32744c01492c tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:38.970594 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_cell0:SELECT=2 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:39.111159 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-35bd1e7d-82ae-4d87-a279-1fc097a24c1f tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:39.111781 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-35bd1e7d-82ae-4d87-a279-1fc097a24c1f tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1e6f9976-8df1-4719-a873-ab83b056f95e] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:39.122203 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-35bd1e7d-82ae-4d87-a279-1fc097a24c1f tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:39.122705 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-35bd1e7d-82ae-4d87-a279-1fc097a24c1f tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:39.135408 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-35bd1e7d-82ae-4d87-a279-1fc097a24c1f tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:39.136034 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-35bd1e7d-82ae-4d87-a279-1fc097a24c1f tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:39.708116 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-35bd1e7d-82ae-4d87-a279-1fc097a24c1f tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:39.726391 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-35bd1e7d-82ae-4d87-a279-1fc097a24c1f tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e" status: 200 len: 1280 microversion: 2.1 time: 0.617446 Jun 16 18:59:39.730226 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 16/32] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:39 2022] GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e => generated 1280 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:40.745490 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-cde83846-bec6-4fee-9dfc-1b298be5ec97 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:40.746168 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-cde83846-bec6-4fee-9dfc-1b298be5ec97 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1e6f9976-8df1-4719-a873-ab83b056f95e] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:40.767476 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-cde83846-bec6-4fee-9dfc-1b298be5ec97 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:40.768440 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-cde83846-bec6-4fee-9dfc-1b298be5ec97 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:40.769556 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-cde83846-bec6-4fee-9dfc-1b298be5ec97 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:40.770798 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-cde83846-bec6-4fee-9dfc-1b298be5ec97 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:40.851946 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-963aba13-61d6-4d0e-8d9f-32744c01492c tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8813b3f6f8c46519fb827cf521bb37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de0652519d3447b8d0e4d948610071f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:40.901310 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-963aba13-61d6-4d0e-8d9f-32744c01492c tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] 10.222.0.70 "GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d" status: 200 len: 1315 microversion: 2.1 time: 2.332456 Jun 16 18:59:40.907976 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 17/33] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:38 2022] GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d => generated 1315 bytes in 2341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:41.204118 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-cde83846-bec6-4fee-9dfc-1b298be5ec97 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:41.214650 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-cde83846-bec6-4fee-9dfc-1b298be5ec97 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e" status: 200 len: 1280 microversion: 2.1 time: 0.472863 Jun 16 18:59:41.216816 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 17/34] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:40 2022] GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e => generated 1280 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:59:41.600577 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-68fcbade-73f6-4e4e-a5e1-00adac6d4bc1 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1981312789", "imageRef": "1d993e69-7f01-4fe0-ba52-0eae2fa43ddf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "35458482-ba39-48d4-bef8-d8e2a6441bb8"}], "security_groups": [{"name": "tempest-securitygroup--399063111"}], "key_name": "tempest-keypair-170023621", "user_data": "}} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:59:41.935008 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-1ad5a146-a462-4dec-89d6-f4c6c4547852 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:41.948111 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-1ad5a146-a462-4dec-89d6-f4c6c4547852 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] [instance: de7eb4c7-a555-44f0-84c2-428b23b31a2d] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:41.963289 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-1ad5a146-a462-4dec-89d6-f4c6c4547852 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:41.967720 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-1ad5a146-a462-4dec-89d6-f4c6c4547852 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:41.969009 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-1ad5a146-a462-4dec-89d6-f4c6c4547852 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:41.971964 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-1ad5a146-a462-4dec-89d6-f4c6c4547852 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:42.097040 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_cell0:SELECT=18 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:42.179042 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.network.neutron [None req-68fcbade-73f6-4e4e-a5e1-00adac6d4bc1 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] validate_networks() for [('35458482-ba39-48d4-bef8-d8e2a6441bb8', None, None, None, None, None)] {{(pid=117852) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:59:43.487486 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_cell0:SELECT=4 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:43.731811 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-1ad5a146-a462-4dec-89d6-f4c6c4547852 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8813b3f6f8c46519fb827cf521bb37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de0652519d3447b8d0e4d948610071f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:43.750396 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-1ad5a146-a462-4dec-89d6-f4c6c4547852 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] 10.222.0.70 "GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d" status: 200 len: 1315 microversion: 2.1 time: 1.828408 Jun 16 18:59:43.763120 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 18/35] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:41 2022] GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d => generated 1315 bytes in 1842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:43.777731 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-399496ef-e148-49ff-a0d4-e3fb84e93744 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:43.785979 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-399496ef-e148-49ff-a0d4-e3fb84e93744 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1e6f9976-8df1-4719-a873-ab83b056f95e] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:43.858297 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-399496ef-e148-49ff-a0d4-e3fb84e93744 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:43.874759 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-399496ef-e148-49ff-a0d4-e3fb84e93744 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:43.877861 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-399496ef-e148-49ff-a0d4-e3fb84e93744 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:43.880302 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-399496ef-e148-49ff-a0d4-e3fb84e93744 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:44.126346 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_cell0:SELECT=16 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:45.283324 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-399496ef-e148-49ff-a0d4-e3fb84e93744 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:45.302179 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-399496ef-e148-49ff-a0d4-e3fb84e93744 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e" status: 200 len: 1322 microversion: 2.1 time: 1.530654 Jun 16 18:59:45.318667 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 19/36] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:43 2022] GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e => generated 1322 bytes in 1554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:45.327589 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-74c164c3-ab9c-4212-83bc-28eefb35d10f tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-350560943", "imageRef": "1d993e69-7f01-4fe0-ba52-0eae2fa43ddf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9c908ec1-4026-4e51-a872-55ce45d602ca"}], "security_groups": [{"name": "tempest-securitygroup--2119884072"}], "key_name": "tempest-keypair-644366971", "user_data": "}} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:59:45.848478 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.virt.hardware [None req-68fcbade-73f6-4e4e-a5e1-00adac6d4bc1 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Flavor limits 0:0:0 {{(pid=117852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:59:45.849203 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.virt.hardware [None req-68fcbade-73f6-4e4e-a5e1-00adac6d4bc1 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Image limits 0:0:0 {{(pid=117852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:59:45.849696 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.virt.hardware [None req-68fcbade-73f6-4e4e-a5e1-00adac6d4bc1 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Flavor pref 0:0:0 {{(pid=117852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:59:45.850117 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.virt.hardware [None req-68fcbade-73f6-4e4e-a5e1-00adac6d4bc1 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Image pref 0:0:0 {{(pid=117852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:59:45.850536 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.virt.hardware [None req-68fcbade-73f6-4e4e-a5e1-00adac6d4bc1 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:59:45.872497 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-68fcbade-73f6-4e4e-a5e1-00adac6d4bc1 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:45.872960 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-68fcbade-73f6-4e4e-a5e1-00adac6d4bc1 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:45.877516 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-68fcbade-73f6-4e4e-a5e1-00adac6d4bc1 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:45.877988 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-68fcbade-73f6-4e4e-a5e1-00adac6d4bc1 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:45.983499 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.quota [None req-68fcbade-73f6-4e4e-a5e1-00adac6d4bc1 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Getting quotas for project 057aef18c52b49a382450331694c04d6. Resources: {'cores', 'ram', 'instances'} {{(pid=117852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:59:45.994954 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.quota [None req-68fcbade-73f6-4e4e-a5e1-00adac6d4bc1 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Getting quotas for user 04327f3d7b844ddb88cf4a81145634c4 and project 057aef18c52b49a382450331694c04d6. Resources: {'cores', 'ram', 'instances'} {{(pid=117852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:59:46.040479 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-68fcbade-73f6-4e4e-a5e1-00adac6d4bc1 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Going to run 1 instances... {{(pid=117852) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:59:46.045159 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-68fcbade-73f6-4e4e-a5e1-00adac6d4bc1 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1d993e69-7f01-4fe0-ba52-0eae2fa43ddf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117852) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:59:46.240488 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-68fcbade-73f6-4e4e-a5e1-00adac6d4bc1 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 4.645529 Jun 16 18:59:46.252809 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 18/37] 10.222.0.70 () {62 vars in 1187 bytes} [Thu Jun 16 18:59:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 4659 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 16 18:59:46.261881 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-7e99585b-6dcf-4b43-ad07-668265052b94 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:46.263329 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-7e99585b-6dcf-4b43-ad07-668265052b94 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] [instance: de7eb4c7-a555-44f0-84c2-428b23b31a2d] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:46.273477 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-7e99585b-6dcf-4b43-ad07-668265052b94 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:46.273939 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-7e99585b-6dcf-4b43-ad07-668265052b94 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:46.274796 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-7e99585b-6dcf-4b43-ad07-668265052b94 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:46.275243 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-7e99585b-6dcf-4b43-ad07-668265052b94 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:46.289636 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.network.neutron [None req-74c164c3-ab9c-4212-83bc-28eefb35d10f tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] validate_networks() for [('9c908ec1-4026-4e51-a872-55ce45d602ca', None, None, None, None, None)] {{(pid=117850) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 18:59:47.549422 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-7e99585b-6dcf-4b43-ad07-668265052b94 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8813b3f6f8c46519fb827cf521bb37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de0652519d3447b8d0e4d948610071f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:47.565845 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-7e99585b-6dcf-4b43-ad07-668265052b94 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] 10.222.0.70 "GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d" status: 200 len: 1315 microversion: 2.1 time: 1.311711 Jun 16 18:59:47.570756 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 19/38] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:46 2022] GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d => generated 1315 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:47.602413 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-6bd419f8-9bd8-4f9e-92af-7287f6ff21d1 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:47.603088 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-6bd419f8-9bd8-4f9e-92af-7287f6ff21d1 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:47.622472 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-6bd419f8-9bd8-4f9e-92af-7287f6ff21d1 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:47.623244 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-6bd419f8-9bd8-4f9e-92af-7287f6ff21d1 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:47.625812 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-6bd419f8-9bd8-4f9e-92af-7287f6ff21d1 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:47.626719 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-6bd419f8-9bd8-4f9e-92af-7287f6ff21d1 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:47.923353 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-74c164c3-ab9c-4212-83bc-28eefb35d10f tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Flavor limits 0:0:0 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 18:59:47.924184 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-74c164c3-ab9c-4212-83bc-28eefb35d10f tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Image limits 0:0:0 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 18:59:47.927281 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-74c164c3-ab9c-4212-83bc-28eefb35d10f tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Flavor pref 0:0:0 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 18:59:47.928045 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-74c164c3-ab9c-4212-83bc-28eefb35d10f tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Image pref 0:0:0 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 18:59:47.928680 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-74c164c3-ab9c-4212-83bc-28eefb35d10f tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 18:59:47.957692 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-74c164c3-ab9c-4212-83bc-28eefb35d10f tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:47.967940 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-74c164c3-ab9c-4212-83bc-28eefb35d10f tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:47.969416 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-74c164c3-ab9c-4212-83bc-28eefb35d10f tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:47.970267 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-74c164c3-ab9c-4212-83bc-28eefb35d10f tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:48.059031 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.quota [None req-74c164c3-ab9c-4212-83bc-28eefb35d10f tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Getting quotas for project d865cf7b3e5c4291a0204f396143083a. Resources: {'cores', 'ram', 'instances'} {{(pid=117850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 18:59:48.072322 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.quota [None req-74c164c3-ab9c-4212-83bc-28eefb35d10f tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Getting quotas for user 8742a73e9b4f46deb0b5c9e1756ffe2e and project d865cf7b3e5c4291a0204f396143083a. Resources: {'cores', 'ram', 'instances'} {{(pid=117850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 18:59:48.112951 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-74c164c3-ab9c-4212-83bc-28eefb35d10f tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Going to run 1 instances... {{(pid=117850) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 18:59:48.117712 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-74c164c3-ab9c-4212-83bc-28eefb35d10f tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1d993e69-7f01-4fe0-ba52-0eae2fa43ddf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 18:59:48.244993 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-74c164c3-ab9c-4212-83bc-28eefb35d10f tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.924681 Jun 16 18:59:48.256845 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 20/39] 10.222.0.70 () {60 vars in 1146 bytes} [Thu Jun 16 18:59:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 2935 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 18:59:48.263009 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-35580ed6-e2ac-49ad-800f-be8200f36ee1 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:48.264345 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-35580ed6-e2ac-49ad-800f-be8200f36ee1 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1e6f9976-8df1-4719-a873-ab83b056f95e] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:48.274799 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-35580ed6-e2ac-49ad-800f-be8200f36ee1 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:48.275454 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-35580ed6-e2ac-49ad-800f-be8200f36ee1 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:48.276705 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-35580ed6-e2ac-49ad-800f-be8200f36ee1 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:48.277417 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-35580ed6-e2ac-49ad-800f-be8200f36ee1 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:48.469484 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-6bd419f8-9bd8-4f9e-92af-7287f6ff21d1 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:48.494054 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-6bd419f8-9bd8-4f9e-92af-7287f6ff21d1 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:48.499251 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-6bd419f8-9bd8-4f9e-92af-7287f6ff21d1 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:48.502652 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-6bd419f8-9bd8-4f9e-92af-7287f6ff21d1 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1285 microversion: 2.20 time: 0.930469 Jun 16 18:59:48.506027 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 20/40] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 18:59:47 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1285 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:59:48.524472 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-bb15bc73-076c-4e60-91fc-96d56256cc60 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:48.529707 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-bb15bc73-076c-4e60-91fc-96d56256cc60 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:49.129014 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-35580ed6-e2ac-49ad-800f-be8200f36ee1 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:49.147020 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-35580ed6-e2ac-49ad-800f-be8200f36ee1 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e" status: 200 len: 1322 microversion: 2.1 time: 0.884544 Jun 16 18:59:49.148174 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 21/41] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:48 2022] GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e => generated 1322 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:49.156190 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-d00a5179-c46d-4eb5-9559-ae976de9f88d tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:49.161759 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-d00a5179-c46d-4eb5-9559-ae976de9f88d tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] [instance: de7eb4c7-a555-44f0-84c2-428b23b31a2d] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:49.193014 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d00a5179-c46d-4eb5-9559-ae976de9f88d tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:49.193784 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d00a5179-c46d-4eb5-9559-ae976de9f88d tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:49.198523 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d00a5179-c46d-4eb5-9559-ae976de9f88d tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:49.199656 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d00a5179-c46d-4eb5-9559-ae976de9f88d tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:49.511732 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-bb15bc73-076c-4e60-91fc-96d56256cc60 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:49.529720 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-bb15bc73-076c-4e60-91fc-96d56256cc60 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1236 microversion: 2.1 time: 1.021538 Jun 16 18:59:49.536201 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 21/42] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:48 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1236 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:49.864169 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-d00a5179-c46d-4eb5-9559-ae976de9f88d tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8813b3f6f8c46519fb827cf521bb37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de0652519d3447b8d0e4d948610071f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:49.872848 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-d00a5179-c46d-4eb5-9559-ae976de9f88d tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] 10.222.0.70 "GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d" status: 200 len: 1315 microversion: 2.1 time: 0.720363 Jun 16 18:59:49.874870 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 22/43] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:49 2022] GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d => generated 1315 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:49.883386 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-e06290b3-b24c-417b-b88b-b6e2a8bb08c0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:49.895032 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-e06290b3-b24c-417b-b88b-b6e2a8bb08c0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:49.904864 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-e06290b3-b24c-417b-b88b-b6e2a8bb08c0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:49.909759 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-e06290b3-b24c-417b-b88b-b6e2a8bb08c0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:49.913141 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-e06290b3-b24c-417b-b88b-b6e2a8bb08c0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:49.913835 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-e06290b3-b24c-417b-b88b-b6e2a8bb08c0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:50.343650 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-e06290b3-b24c-417b-b88b-b6e2a8bb08c0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:50.450544 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-e06290b3-b24c-417b-b88b-b6e2a8bb08c0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:50.457754 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-e06290b3-b24c-417b-b88b-b6e2a8bb08c0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:50.469794 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [req-90832192-6246-4376-b4a0-bac3874fe839 req-4b105e83-0f7f-48ee-86ce-4ddb8f62700a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de7eb4c7-a555-44f0-84c2-428b23b31a2d", "tag": "77abca93-521b-4d16-a289-8aedb986871d"}]} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:59:50.473019 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-e06290b3-b24c-417b-b88b-b6e2a8bb08c0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1339 microversion: 2.20 time: 0.589737 Jun 16 18:59:50.473678 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 23/44] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 18:59:49 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1339 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:59:50.489680 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-59ad7747-cbc4-4342-9064-e15df37e1f9f tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:50.490309 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-59ad7747-cbc4-4342-9064-e15df37e1f9f tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1e6f9976-8df1-4719-a873-ab83b056f95e] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:50.496842 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-59ad7747-cbc4-4342-9064-e15df37e1f9f tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:50.497488 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-59ad7747-cbc4-4342-9064-e15df37e1f9f tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:50.498429 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-59ad7747-cbc4-4342-9064-e15df37e1f9f tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:50.499046 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-59ad7747-cbc4-4342-9064-e15df37e1f9f tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:50.536012 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-90832192-6246-4376-b4a0-bac3874fe839 req-4b105e83-0f7f-48ee-86ce-4ddb8f62700a service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:50.544474 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-90832192-6246-4376-b4a0-bac3874fe839 req-4b105e83-0f7f-48ee-86ce-4ddb8f62700a service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:50.585246 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.compute.server_external_events [req-90832192-6246-4376-b4a0-bac3874fe839 req-4b105e83-0f7f-48ee-86ce-4ddb8f62700a service nova] Creating event network-changed:77abca93-521b-4d16-a289-8aedb986871d for instance de7eb4c7-a555-44f0-84c2-428b23b31a2d on hv-cinder-84617 Jun 16 18:59:50.585790 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-90832192-6246-4376-b4a0-bac3874fe839 req-4b105e83-0f7f-48ee-86ce-4ddb8f62700a service nova] Acquired lock "compute-rpcapi-router" {{(pid=117852) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 16 18:59:50.586962 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-14e3123c-7e73-4ae9-9e47-2d92d5a03939 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:50.587412 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-14e3123c-7e73-4ae9-9e47-2d92d5a03939 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:50.588196 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-14e3123c-7e73-4ae9-9e47-2d92d5a03939 None None] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:50.595105 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-14e3123c-7e73-4ae9-9e47-2d92d5a03939 None None] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:50.605558 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.compute.rpcapi [None req-14e3123c-7e73-4ae9-9e47-2d92d5a03939 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 16 18:59:50.606776 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-14e3123c-7e73-4ae9-9e47-2d92d5a03939 None None] Releasing lock "compute-rpcapi-router" {{(pid=117852) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 16 18:59:50.649005 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-14e3123c-7e73-4ae9-9e47-2d92d5a03939 None None] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.109109 Jun 16 18:59:50.650284 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 22/45] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 18:59:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:59:50.659475 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-1562f776-87e6-4558-8d1f-03232a3c3115 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:50.660622 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-1562f776-87e6-4558-8d1f-03232a3c3115 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:50.672223 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-1562f776-87e6-4558-8d1f-03232a3c3115 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:50.672982 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-1562f776-87e6-4558-8d1f-03232a3c3115 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:50.675799 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-1562f776-87e6-4558-8d1f-03232a3c3115 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:50.676246 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-1562f776-87e6-4558-8d1f-03232a3c3115 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:50.820767 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-1562f776-87e6-4558-8d1f-03232a3c3115 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:50.833905 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-1562f776-87e6-4558-8d1f-03232a3c3115 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1288 microversion: 2.1 time: 0.180186 Jun 16 18:59:50.838149 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 23/46] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:50 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1288 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:50.918545 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-407c0cfd-5c80-4764-956a-3bd6c436e550 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:50.919539 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-407c0cfd-5c80-4764-956a-3bd6c436e550 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] [instance: de7eb4c7-a555-44f0-84c2-428b23b31a2d] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:50.968074 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-407c0cfd-5c80-4764-956a-3bd6c436e550 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:50.968589 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-407c0cfd-5c80-4764-956a-3bd6c436e550 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:50.969752 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-407c0cfd-5c80-4764-956a-3bd6c436e550 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:50.970201 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-407c0cfd-5c80-4764-956a-3bd6c436e550 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:51.220256 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-59ad7747-cbc4-4342-9064-e15df37e1f9f tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:51.232324 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-59ad7747-cbc4-4342-9064-e15df37e1f9f tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e" status: 200 len: 1322 microversion: 2.1 time: 0.757534 Jun 16 18:59:51.237186 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 24/47] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:50 2022] GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e => generated 1322 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:51.415762 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-407c0cfd-5c80-4764-956a-3bd6c436e550 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8813b3f6f8c46519fb827cf521bb37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de0652519d3447b8d0e4d948610071f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:51.419687 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_cell1:SELECT=55 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:51.429399 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-407c0cfd-5c80-4764-956a-3bd6c436e550 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] 10.222.0.70 "GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d" status: 200 len: 1315 microversion: 2.1 time: 0.533432 Jun 16 18:59:51.437395 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 24/48] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:50 2022] GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d => generated 1315 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:51.497147 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-aff45f78-c44b-4e53-9196-d82076819fb2 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:51.498431 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-aff45f78-c44b-4e53-9196-d82076819fb2 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:51.506049 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=8 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:51.509770 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-aff45f78-c44b-4e53-9196-d82076819fb2 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:51.510722 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-aff45f78-c44b-4e53-9196-d82076819fb2 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:51.511986 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-aff45f78-c44b-4e53-9196-d82076819fb2 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:51.512575 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-aff45f78-c44b-4e53-9196-d82076819fb2 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:51.700219 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-aff45f78-c44b-4e53-9196-d82076819fb2 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:51.700936 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [req-fa88d2ea-9e97-40ed-a2c9-ce7da961de01 req-445dce49-ba5b-4c04-9f89-5e91b8a3a6a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e6f9976-8df1-4719-a873-ab83b056f95e", "tag": "00684661-7e70-4475-bd72-3ea8303e4612"}]} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:59:51.710914 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-aff45f78-c44b-4e53-9196-d82076819fb2 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:51.713951 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-aff45f78-c44b-4e53-9196-d82076819fb2 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:51.715158 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-aff45f78-c44b-4e53-9196-d82076819fb2 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1406 microversion: 2.20 time: 0.224535 Jun 16 18:59:51.715766 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 25/49] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 18:59:51 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1406 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:59:51.738088 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-fa88d2ea-9e97-40ed-a2c9-ce7da961de01 req-445dce49-ba5b-4c04-9f89-5e91b8a3a6a1 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:51.738541 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-fa88d2ea-9e97-40ed-a2c9-ce7da961de01 req-445dce49-ba5b-4c04-9f89-5e91b8a3a6a1 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:51.761456 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.compute.server_external_events [req-fa88d2ea-9e97-40ed-a2c9-ce7da961de01 req-445dce49-ba5b-4c04-9f89-5e91b8a3a6a1 service nova] Creating event network-changed:00684661-7e70-4475-bd72-3ea8303e4612 for instance 1e6f9976-8df1-4719-a873-ab83b056f95e on hv-cinder-84617 Jun 16 18:59:51.762000 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-fa88d2ea-9e97-40ed-a2c9-ce7da961de01 req-445dce49-ba5b-4c04-9f89-5e91b8a3a6a1 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117850) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 16 18:59:51.763753 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-e3888ec8-b0b7-456a-a099-c519aba78ea6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:51.764117 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-e3888ec8-b0b7-456a-a099-c519aba78ea6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:51.764872 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-e3888ec8-b0b7-456a-a099-c519aba78ea6 None None] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:51.765403 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-e3888ec8-b0b7-456a-a099-c519aba78ea6 None None] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:51.784792 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.compute.rpcapi [None req-e3888ec8-b0b7-456a-a099-c519aba78ea6 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 16 18:59:51.786791 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-e3888ec8-b0b7-456a-a099-c519aba78ea6 None None] Releasing lock "compute-rpcapi-router" {{(pid=117850) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 16 18:59:51.814365 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-e3888ec8-b0b7-456a-a099-c519aba78ea6 None None] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.565859 Jun 16 18:59:51.815401 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 25/50] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 18:59:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 18:59:51.861834 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-d1e60b67-8e87-4637-92a3-c1699e851fd1 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:51.863646 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-d1e60b67-8e87-4637-92a3-c1699e851fd1 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:51.879042 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d1e60b67-8e87-4637-92a3-c1699e851fd1 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:51.884285 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d1e60b67-8e87-4637-92a3-c1699e851fd1 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:51.885557 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d1e60b67-8e87-4637-92a3-c1699e851fd1 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:51.886124 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d1e60b67-8e87-4637-92a3-c1699e851fd1 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:51.993681 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-d1e60b67-8e87-4637-92a3-c1699e851fd1 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:52.004848 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-d1e60b67-8e87-4637-92a3-c1699e851fd1 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1306 microversion: 2.1 time: 0.150517 Jun 16 18:59:52.016187 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 26/51] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:51 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1306 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:52.256768 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-fe826a67-2154-4362-8e8b-ef399866285b tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:52.257683 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-fe826a67-2154-4362-8e8b-ef399866285b tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1e6f9976-8df1-4719-a873-ab83b056f95e] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:52.264564 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-fe826a67-2154-4362-8e8b-ef399866285b tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:52.279592 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-fe826a67-2154-4362-8e8b-ef399866285b tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:52.280873 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-fe826a67-2154-4362-8e8b-ef399866285b tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:52.282461 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-fe826a67-2154-4362-8e8b-ef399866285b tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:52.447510 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-895cc937-7bf6-4b07-a331-fcc0ebbd095d tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:52.448218 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-895cc937-7bf6-4b07-a331-fcc0ebbd095d tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] [instance: de7eb4c7-a555-44f0-84c2-428b23b31a2d] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:52.457082 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-895cc937-7bf6-4b07-a331-fcc0ebbd095d tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:52.460337 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-895cc937-7bf6-4b07-a331-fcc0ebbd095d tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:52.461415 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-895cc937-7bf6-4b07-a331-fcc0ebbd095d tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:52.467277 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-895cc937-7bf6-4b07-a331-fcc0ebbd095d tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:52.766368 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-fe826a67-2154-4362-8e8b-ef399866285b tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:52.779003 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-fe826a67-2154-4362-8e8b-ef399866285b tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e" status: 200 len: 1322 microversion: 2.1 time: 0.529319 Jun 16 18:59:52.781346 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 26/52] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:52 2022] GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e => generated 1322 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:52.795227 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [req-0a748ac5-2577-42c9-9b5e-d7785cd47818 req-bfd86847-2d5d-4572-8259-653b9b703380 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1407f346-2c64-41d0-b983-268e60273230", "tag": "52a8ab2b-91b4-4c2c-b7aa-df9981b16adf"}]} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:59:52.815468 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-0a748ac5-2577-42c9-9b5e-d7785cd47818 req-bfd86847-2d5d-4572-8259-653b9b703380 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:52.819338 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-0a748ac5-2577-42c9-9b5e-d7785cd47818 req-bfd86847-2d5d-4572-8259-653b9b703380 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:52.851293 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.compute.server_external_events [req-0a748ac5-2577-42c9-9b5e-d7785cd47818 req-bfd86847-2d5d-4572-8259-653b9b703380 service nova] Creating event network-changed:52a8ab2b-91b4-4c2c-b7aa-df9981b16adf for instance 1407f346-2c64-41d0-b983-268e60273230 on hv-cinder-84617 Jun 16 18:59:52.862666 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [req-0a748ac5-2577-42c9-9b5e-d7785cd47818 req-bfd86847-2d5d-4572-8259-653b9b703380 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079095 Jun 16 18:59:52.864795 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 27/53] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 18:59:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:59:52.888379 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-b06433e8-de94-4a97-9080-9e8ed020965e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:52.889149 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-b06433e8-de94-4a97-9080-9e8ed020965e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:52.909625 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b06433e8-de94-4a97-9080-9e8ed020965e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:52.910085 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b06433e8-de94-4a97-9080-9e8ed020965e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:52.910943 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b06433e8-de94-4a97-9080-9e8ed020965e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:52.911385 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b06433e8-de94-4a97-9080-9e8ed020965e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:53.108590 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-895cc937-7bf6-4b07-a331-fcc0ebbd095d tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8813b3f6f8c46519fb827cf521bb37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de0652519d3447b8d0e4d948610071f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:53.116438 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-895cc937-7bf6-4b07-a331-fcc0ebbd095d tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] 10.222.0.70 "GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d" status: 200 len: 1315 microversion: 2.1 time: 0.673218 Jun 16 18:59:53.125824 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 27/54] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:52 2022] GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d => generated 1315 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:53.130895 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-bd0573f5-3ea2-4668-93fd-2dfa1085dc1c tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:53.131563 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-bd0573f5-3ea2-4668-93fd-2dfa1085dc1c tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:53.146544 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-bd0573f5-3ea2-4668-93fd-2dfa1085dc1c tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:53.147053 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-bd0573f5-3ea2-4668-93fd-2dfa1085dc1c tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:53.147843 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-bd0573f5-3ea2-4668-93fd-2dfa1085dc1c tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:53.148280 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-bd0573f5-3ea2-4668-93fd-2dfa1085dc1c tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:53.352637 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-bd0573f5-3ea2-4668-93fd-2dfa1085dc1c tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:53.373283 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-bd0573f5-3ea2-4668-93fd-2dfa1085dc1c tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1294 microversion: 2.1 time: 0.246175 Jun 16 18:59:53.383100 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 28/55] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:53 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1294 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:53.493577 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-b06433e8-de94-4a97-9080-9e8ed020965e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:53.503011 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_cell1:SELECT=83 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:53.507245 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-b06433e8-de94-4a97-9080-9e8ed020965e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:53.510254 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-b06433e8-de94-4a97-9080-9e8ed020965e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:53.518125 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-b06433e8-de94-4a97-9080-9e8ed020965e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1406 microversion: 2.20 time: 0.649606 Jun 16 18:59:53.521378 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 28/56] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 18:59:52 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1406 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:59:53.798452 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-2eca71d9-0491-461e-90d5-77100d1aa631 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:53.804146 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-2eca71d9-0491-461e-90d5-77100d1aa631 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1e6f9976-8df1-4719-a873-ab83b056f95e] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:53.813464 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-2eca71d9-0491-461e-90d5-77100d1aa631 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:53.814309 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-2eca71d9-0491-461e-90d5-77100d1aa631 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:53.815316 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-2eca71d9-0491-461e-90d5-77100d1aa631 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:53.815905 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-2eca71d9-0491-461e-90d5-77100d1aa631 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:54.136817 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-77b3ec22-b384-4d4f-89dc-39d43158b77c tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:54.138698 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-77b3ec22-b384-4d4f-89dc-39d43158b77c tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] [instance: de7eb4c7-a555-44f0-84c2-428b23b31a2d] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:54.142362 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=9 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:54.156777 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-77b3ec22-b384-4d4f-89dc-39d43158b77c tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:54.162498 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-77b3ec22-b384-4d4f-89dc-39d43158b77c tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:54.163670 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-77b3ec22-b384-4d4f-89dc-39d43158b77c tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:54.164400 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-77b3ec22-b384-4d4f-89dc-39d43158b77c tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:54.241785 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-2eca71d9-0491-461e-90d5-77100d1aa631 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:54.252892 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-2eca71d9-0491-461e-90d5-77100d1aa631 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e" status: 200 len: 1322 microversion: 2.1 time: 0.459042 Jun 16 18:59:54.254909 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 29/57] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:53 2022] GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e => generated 1322 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:54.266500 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [req-2cd28d71-a198-46b7-80bf-552852f771c4 req-cea71f4b-a6f2-4913-87cc-b632567213ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c077a29-12e0-48af-a8b6-43d0b5a79bf4", "tag": "3e9e841e-467e-4321-a3d7-1999929bc359"}]} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:59:54.286013 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-2cd28d71-a198-46b7-80bf-552852f771c4 req-cea71f4b-a6f2-4913-87cc-b632567213ef service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:54.289415 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-2cd28d71-a198-46b7-80bf-552852f771c4 req-cea71f4b-a6f2-4913-87cc-b632567213ef service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:54.319958 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.compute.server_external_events [req-2cd28d71-a198-46b7-80bf-552852f771c4 req-cea71f4b-a6f2-4913-87cc-b632567213ef service nova] Creating event network-changed:3e9e841e-467e-4321-a3d7-1999929bc359 for instance 1c077a29-12e0-48af-a8b6-43d0b5a79bf4 on hv-cinder-84617 Jun 16 18:59:54.341364 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [req-2cd28d71-a198-46b7-80bf-552852f771c4 req-cea71f4b-a6f2-4913-87cc-b632567213ef service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085025 Jun 16 18:59:54.342683 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 30/58] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 18:59:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:59:54.392312 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-28ef3e2b-7c24-40d8-9fdb-a93a975a68d4 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:54.393182 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-28ef3e2b-7c24-40d8-9fdb-a93a975a68d4 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:54.405736 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-28ef3e2b-7c24-40d8-9fdb-a93a975a68d4 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:54.408351 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-28ef3e2b-7c24-40d8-9fdb-a93a975a68d4 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:54.410979 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-28ef3e2b-7c24-40d8-9fdb-a93a975a68d4 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:54.413356 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-28ef3e2b-7c24-40d8-9fdb-a93a975a68d4 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:54.600008 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-28ef3e2b-7c24-40d8-9fdb-a93a975a68d4 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:54.612336 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-28ef3e2b-7c24-40d8-9fdb-a93a975a68d4 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1294 microversion: 2.1 time: 0.224353 Jun 16 18:59:54.614311 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 31/59] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:54 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1294 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:59:54.626779 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-9bedf5bb-4f64-4d2f-bb9b-c3608601ea31 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:54.627815 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-9bedf5bb-4f64-4d2f-bb9b-c3608601ea31 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:54.643380 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-9bedf5bb-4f64-4d2f-bb9b-c3608601ea31 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:54.644136 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-9bedf5bb-4f64-4d2f-bb9b-c3608601ea31 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:54.646106 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-9bedf5bb-4f64-4d2f-bb9b-c3608601ea31 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:54.647187 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-9bedf5bb-4f64-4d2f-bb9b-c3608601ea31 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:54.920478 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-77b3ec22-b384-4d4f-89dc-39d43158b77c tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8813b3f6f8c46519fb827cf521bb37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de0652519d3447b8d0e4d948610071f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:54.948089 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-77b3ec22-b384-4d4f-89dc-39d43158b77c tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] 10.222.0.70 "GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d" status: 200 len: 1315 microversion: 2.1 time: 0.812373 Jun 16 18:59:54.948089 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 29/60] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:54 2022] GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d => generated 1315 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:55.062351 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-9bedf5bb-4f64-4d2f-bb9b-c3608601ea31 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:55.098319 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-9bedf5bb-4f64-4d2f-bb9b-c3608601ea31 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:55.101064 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-9bedf5bb-4f64-4d2f-bb9b-c3608601ea31 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:55.102797 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-9bedf5bb-4f64-4d2f-bb9b-c3608601ea31 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1406 microversion: 2.20 time: 0.485692 Jun 16 18:59:55.104167 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 32/61] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 18:59:54 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1406 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:59:55.282115 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-6e896c0c-d09c-409e-a517-fc2699e669d8 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:55.283010 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-6e896c0c-d09c-409e-a517-fc2699e669d8 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1e6f9976-8df1-4719-a873-ab83b056f95e] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:55.290243 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-6e896c0c-d09c-409e-a517-fc2699e669d8 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:55.291075 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-6e896c0c-d09c-409e-a517-fc2699e669d8 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:55.292901 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-6e896c0c-d09c-409e-a517-fc2699e669d8 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:55.293553 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-6e896c0c-d09c-409e-a517-fc2699e669d8 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:55.641567 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-13328434-0dc1-48e5-8a55-487112c652b3 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:55.642609 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-13328434-0dc1-48e5-8a55-487112c652b3 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:55.663404 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-13328434-0dc1-48e5-8a55-487112c652b3 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:55.664168 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-13328434-0dc1-48e5-8a55-487112c652b3 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:55.666697 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-13328434-0dc1-48e5-8a55-487112c652b3 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:55.667532 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-13328434-0dc1-48e5-8a55-487112c652b3 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:55.677131 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-6e896c0c-d09c-409e-a517-fc2699e669d8 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:55.696685 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-6e896c0c-d09c-409e-a517-fc2699e669d8 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e" status: 200 len: 1322 microversion: 2.1 time: 0.416352 Jun 16 18:59:55.708802 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 30/62] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:55 2022] GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e => generated 1322 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:55.970506 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-7f90f956-2ae5-420f-ae5d-0daad8bc8387 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:55.971260 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-7f90f956-2ae5-420f-ae5d-0daad8bc8387 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] [instance: de7eb4c7-a555-44f0-84c2-428b23b31a2d] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:55.985035 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-7f90f956-2ae5-420f-ae5d-0daad8bc8387 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:55.986294 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-7f90f956-2ae5-420f-ae5d-0daad8bc8387 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:55.987360 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-7f90f956-2ae5-420f-ae5d-0daad8bc8387 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:55.988355 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-7f90f956-2ae5-420f-ae5d-0daad8bc8387 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:56.430781 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-13328434-0dc1-48e5-8a55-487112c652b3 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:56.452861 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-13328434-0dc1-48e5-8a55-487112c652b3 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1362 microversion: 2.1 time: 0.818425 Jun 16 18:59:56.471376 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 33/63] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:55 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1362 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:56.486261 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-7f90f956-2ae5-420f-ae5d-0daad8bc8387 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8813b3f6f8c46519fb827cf521bb37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de0652519d3447b8d0e4d948610071f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:56.501765 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-7f90f956-2ae5-420f-ae5d-0daad8bc8387 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] 10.222.0.70 "GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d" status: 200 len: 1315 microversion: 2.1 time: 0.536127 Jun 16 18:59:56.502255 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-169d85ba-4ba2-4eae-88d7-fe327da758fc tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:56.503174 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-169d85ba-4ba2-4eae-88d7-fe327da758fc tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:56.514265 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 31/64] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:55 2022] GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d => generated 1315 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:56.523078 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-169d85ba-4ba2-4eae-88d7-fe327da758fc tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:56.524365 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-169d85ba-4ba2-4eae-88d7-fe327da758fc tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:56.526377 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-169d85ba-4ba2-4eae-88d7-fe327da758fc tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:56.527081 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-169d85ba-4ba2-4eae-88d7-fe327da758fc tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:56.718053 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-2d1a569d-0095-4f2f-9e1e-dbc11d4d3ada tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:56.720621 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-2d1a569d-0095-4f2f-9e1e-dbc11d4d3ada tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1e6f9976-8df1-4719-a873-ab83b056f95e] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:56.764834 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-2d1a569d-0095-4f2f-9e1e-dbc11d4d3ada tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:56.769084 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-2d1a569d-0095-4f2f-9e1e-dbc11d4d3ada tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:56.770940 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-2d1a569d-0095-4f2f-9e1e-dbc11d4d3ada tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:56.771607 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-2d1a569d-0095-4f2f-9e1e-dbc11d4d3ada tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:56.947454 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-169d85ba-4ba2-4eae-88d7-fe327da758fc tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:56.985462 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-169d85ba-4ba2-4eae-88d7-fe327da758fc tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:56.990835 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-169d85ba-4ba2-4eae-88d7-fe327da758fc tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:56.994110 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-169d85ba-4ba2-4eae-88d7-fe327da758fc tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1406 microversion: 2.20 time: 0.518738 Jun 16 18:59:56.995545 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 34/65] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 18:59:56 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1406 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:59:57.142920 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-2d1a569d-0095-4f2f-9e1e-dbc11d4d3ada tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:57.153206 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-2d1a569d-0095-4f2f-9e1e-dbc11d4d3ada tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e" status: 200 len: 1322 microversion: 2.1 time: 0.440276 Jun 16 18:59:57.153803 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 32/66] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:56 2022] GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e => generated 1322 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:57.479426 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-6865c88c-0dea-4c25-bafb-1e6df8b7a80e tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:57.480001 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-6865c88c-0dea-4c25-bafb-1e6df8b7a80e tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:57.488969 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-6865c88c-0dea-4c25-bafb-1e6df8b7a80e tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:57.489336 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-6865c88c-0dea-4c25-bafb-1e6df8b7a80e tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:57.490116 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-6865c88c-0dea-4c25-bafb-1e6df8b7a80e tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:57.490547 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-6865c88c-0dea-4c25-bafb-1e6df8b7a80e tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:57.521679 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-b141681b-f2a7-4c95-b4b4-b9a27e369873 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:57.523980 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-b141681b-f2a7-4c95-b4b4-b9a27e369873 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] [instance: de7eb4c7-a555-44f0-84c2-428b23b31a2d] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:57.536494 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b141681b-f2a7-4c95-b4b4-b9a27e369873 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:57.536954 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b141681b-f2a7-4c95-b4b4-b9a27e369873 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:57.537734 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b141681b-f2a7-4c95-b4b4-b9a27e369873 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:57.543490 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b141681b-f2a7-4c95-b4b4-b9a27e369873 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:57.878101 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-b141681b-f2a7-4c95-b4b4-b9a27e369873 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8813b3f6f8c46519fb827cf521bb37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de0652519d3447b8d0e4d948610071f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:57.881897 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-6865c88c-0dea-4c25-bafb-1e6df8b7a80e tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:57.890320 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-b141681b-f2a7-4c95-b4b4-b9a27e369873 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] 10.222.0.70 "GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d" status: 200 len: 1315 microversion: 2.1 time: 0.373305 Jun 16 18:59:57.899942 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-6865c88c-0dea-4c25-bafb-1e6df8b7a80e tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1362 microversion: 2.1 time: 0.423854 Jun 16 18:59:57.907860 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 33/67] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:57 2022] GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d => generated 1315 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:57.912469 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 35/68] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:57 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1362 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:57.917749 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [req-29503df8-71eb-4ce0-8c95-2521e0e39d46 req-8ec5a43b-e82a-4a86-b779-e1cedc16c7e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fb4cc0a-23a8-417c-a8a1-35501c2690ee", "tag": "523e7a48-bea7-4e32-9e88-5f62ea569a81"}]} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:59:57.934181 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-29503df8-71eb-4ce0-8c95-2521e0e39d46 req-8ec5a43b-e82a-4a86-b779-e1cedc16c7e7 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:57.934949 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-29503df8-71eb-4ce0-8c95-2521e0e39d46 req-8ec5a43b-e82a-4a86-b779-e1cedc16c7e7 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:57.952042 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.compute.server_external_events [req-29503df8-71eb-4ce0-8c95-2521e0e39d46 req-8ec5a43b-e82a-4a86-b779-e1cedc16c7e7 service nova] Creating event network-changed:523e7a48-bea7-4e32-9e88-5f62ea569a81 for instance 2fb4cc0a-23a8-417c-a8a1-35501c2690ee on hv-cinder-84617 Jun 16 18:59:57.963064 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [req-29503df8-71eb-4ce0-8c95-2521e0e39d46 req-8ec5a43b-e82a-4a86-b779-e1cedc16c7e7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052946 Jun 16 18:59:57.965959 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 34/69] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 18:59:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:59:58.013723 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-29abe840-81bf-4235-a007-611003439cd2 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:58.014339 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-29abe840-81bf-4235-a007-611003439cd2 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:58.034465 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-29abe840-81bf-4235-a007-611003439cd2 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:58.035022 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-29abe840-81bf-4235-a007-611003439cd2 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:58.039270 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-29abe840-81bf-4235-a007-611003439cd2 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:58.040018 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-29abe840-81bf-4235-a007-611003439cd2 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:58.170930 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_cell0:SELECT=6 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:58.173314 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-77d3fa48-07e0-4bab-bd57-b39d557ccbb8 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:58.174041 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-77d3fa48-07e0-4bab-bd57-b39d557ccbb8 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1e6f9976-8df1-4719-a873-ab83b056f95e] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:58.186284 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-77d3fa48-07e0-4bab-bd57-b39d557ccbb8 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:58.186799 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-77d3fa48-07e0-4bab-bd57-b39d557ccbb8 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:58.188375 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-77d3fa48-07e0-4bab-bd57-b39d557ccbb8 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:58.188952 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-77d3fa48-07e0-4bab-bd57-b39d557ccbb8 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:58.305641 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-29abe840-81bf-4235-a007-611003439cd2 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:58.315213 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-29abe840-81bf-4235-a007-611003439cd2 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:58.316891 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-29abe840-81bf-4235-a007-611003439cd2 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:58.318032 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-29abe840-81bf-4235-a007-611003439cd2 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1406 microversion: 2.20 time: 0.308433 Jun 16 18:59:58.331536 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 36/70] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 18:59:58 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1406 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:59:58.510672 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-77d3fa48-07e0-4bab-bd57-b39d557ccbb8 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:58.530979 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-77d3fa48-07e0-4bab-bd57-b39d557ccbb8 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e" status: 200 len: 1322 microversion: 2.1 time: 0.362582 Jun 16 18:59:58.534148 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 35/71] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:58 2022] GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e => generated 1322 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:59:58.720656 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [req-71cdf7a2-3601-46a7-bbe9-86a3a4742253 req-42b2a4f0-a50b-424d-b4c0-129939ccc356 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de7eb4c7-a555-44f0-84c2-428b23b31a2d", "name": "network-vif-plugged", "status": "completed", "tag": "77abca93-521b-4d16-a289-8aedb986871d"}]} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 18:59:58.728885 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-71cdf7a2-3601-46a7-bbe9-86a3a4742253 req-42b2a4f0-a50b-424d-b4c0-129939ccc356 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:58.729321 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-71cdf7a2-3601-46a7-bbe9-86a3a4742253 req-42b2a4f0-a50b-424d-b4c0-129939ccc356 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:58.742103 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.compute.server_external_events [req-71cdf7a2-3601-46a7-bbe9-86a3a4742253 req-42b2a4f0-a50b-424d-b4c0-129939ccc356 service nova] Creating event network-vif-plugged:77abca93-521b-4d16-a289-8aedb986871d for instance de7eb4c7-a555-44f0-84c2-428b23b31a2d on hv-cinder-84617 Jun 16 18:59:58.747932 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [req-71cdf7a2-3601-46a7-bbe9-86a3a4742253 req-42b2a4f0-a50b-424d-b4c0-129939ccc356 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123976 Jun 16 18:59:58.748703 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 37/72] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 18:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 18:59:58.914836 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-161cdfee-dc88-4660-83c8-8b59174a8d83 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:58.914836 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-161cdfee-dc88-4660-83c8-8b59174a8d83 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] [instance: de7eb4c7-a555-44f0-84c2-428b23b31a2d] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:58.923590 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-161cdfee-dc88-4660-83c8-8b59174a8d83 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:58.924118 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-161cdfee-dc88-4660-83c8-8b59174a8d83 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:58.924949 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-161cdfee-dc88-4660-83c8-8b59174a8d83 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:58.925294 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-d3d2c4f0-7a0d-49b4-851c-ec0978c48181 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:58.925692 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-161cdfee-dc88-4660-83c8-8b59174a8d83 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:58.926825 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-d3d2c4f0-7a0d-49b4-851c-ec0978c48181 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:58.935120 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d3d2c4f0-7a0d-49b4-851c-ec0978c48181 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:58.936028 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d3d2c4f0-7a0d-49b4-851c-ec0978c48181 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:58.937983 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d3d2c4f0-7a0d-49b4-851c-ec0978c48181 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:58.939105 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d3d2c4f0-7a0d-49b4-851c-ec0978c48181 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:59.081791 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-161cdfee-dc88-4660-83c8-8b59174a8d83 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8813b3f6f8c46519fb827cf521bb37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de0652519d3447b8d0e4d948610071f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:59.091376 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-161cdfee-dc88-4660-83c8-8b59174a8d83 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] 10.222.0.70 "GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d" status: 200 len: 1315 microversion: 2.1 time: 0.181241 Jun 16 18:59:59.092510 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 36/73] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:58 2022] GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 18:59:59.157931 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-d3d2c4f0-7a0d-49b4-851c-ec0978c48181 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:59.170248 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-d3d2c4f0-7a0d-49b4-851c-ec0978c48181 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1362 microversion: 2.1 time: 0.253535 Jun 16 18:59:59.172401 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 38/74] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:58 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1362 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 18:59:59.337867 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-47866a04-2a9f-4eb6-b940-15dd29ff401d tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:59.338607 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-47866a04-2a9f-4eb6-b940-15dd29ff401d tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:59.348359 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-47866a04-2a9f-4eb6-b940-15dd29ff401d tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:59.348940 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-47866a04-2a9f-4eb6-b940-15dd29ff401d tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:59.349891 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-47866a04-2a9f-4eb6-b940-15dd29ff401d tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:59.350604 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-47866a04-2a9f-4eb6-b940-15dd29ff401d tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:59.556225 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-3df34700-2046-4275-bff6-abcee02df7e0 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 18:59:59.557636 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-3df34700-2046-4275-bff6-abcee02df7e0 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1e6f9976-8df1-4719-a873-ab83b056f95e] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 18:59:59.564174 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_cell0:SELECT=8 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 18:59:59.566703 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-3df34700-2046-4275-bff6-abcee02df7e0 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:59.567535 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-3df34700-2046-4275-bff6-abcee02df7e0 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:59.568506 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-3df34700-2046-4275-bff6-abcee02df7e0 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 18:59:59.569123 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-3df34700-2046-4275-bff6-abcee02df7e0 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 18:59:59.591736 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-47866a04-2a9f-4eb6-b940-15dd29ff401d tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:59.606021 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-47866a04-2a9f-4eb6-b940-15dd29ff401d tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:59.607868 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-47866a04-2a9f-4eb6-b940-15dd29ff401d tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:59.609053 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-47866a04-2a9f-4eb6-b940-15dd29ff401d tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1406 microversion: 2.20 time: 0.276559 Jun 16 18:59:59.610603 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 37/75] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 18:59:59 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1406 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 18:59:59.778799 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-3df34700-2046-4275-bff6-abcee02df7e0 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 18:59:59.801609 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-3df34700-2046-4275-bff6-abcee02df7e0 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e" status: 200 len: 1322 microversion: 2.1 time: 0.247565 Jun 16 18:59:59.803683 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 39/76] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 18:59:59 2022] GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e => generated 1322 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:00.110538 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-6a8b5dbe-8c56-492e-a3d1-12456918c4b8 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:00.111746 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-6a8b5dbe-8c56-492e-a3d1-12456918c4b8 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] [instance: de7eb4c7-a555-44f0-84c2-428b23b31a2d] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:00.118666 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-6a8b5dbe-8c56-492e-a3d1-12456918c4b8 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:00.119193 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-6a8b5dbe-8c56-492e-a3d1-12456918c4b8 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:00.119855 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-6a8b5dbe-8c56-492e-a3d1-12456918c4b8 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:00.120476 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-6a8b5dbe-8c56-492e-a3d1-12456918c4b8 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:00.192954 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-bd98a4ff-35f5-4837-bbeb-dde56a1919fe tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:00.193813 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-bd98a4ff-35f5-4837-bbeb-dde56a1919fe tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:00.204286 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-bd98a4ff-35f5-4837-bbeb-dde56a1919fe tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:00.205083 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-bd98a4ff-35f5-4837-bbeb-dde56a1919fe tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:00.206370 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-bd98a4ff-35f5-4837-bbeb-dde56a1919fe tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:00.207195 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-bd98a4ff-35f5-4837-bbeb-dde56a1919fe tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:00.294693 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-6a8b5dbe-8c56-492e-a3d1-12456918c4b8 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8813b3f6f8c46519fb827cf521bb37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de0652519d3447b8d0e4d948610071f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:00.307729 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-6a8b5dbe-8c56-492e-a3d1-12456918c4b8 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] 10.222.0.70 "GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d" status: 200 len: 1315 microversion: 2.1 time: 0.201540 Jun 16 19:00:00.309049 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 38/77] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:00 2022] GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:00.416545 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-bd98a4ff-35f5-4837-bbeb-dde56a1919fe tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:00.426107 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-bd98a4ff-35f5-4837-bbeb-dde56a1919fe tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1362 microversion: 2.1 time: 0.242336 Jun 16 19:00:00.427162 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 40/78] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:00 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1362 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:00:00.630381 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-0eaf914d-a647-4166-9810-f9d00b88c0a8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:00.631037 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-0eaf914d-a647-4166-9810-f9d00b88c0a8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:00.646107 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0eaf914d-a647-4166-9810-f9d00b88c0a8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:00.646563 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0eaf914d-a647-4166-9810-f9d00b88c0a8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:00.647361 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0eaf914d-a647-4166-9810-f9d00b88c0a8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:00.647797 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0eaf914d-a647-4166-9810-f9d00b88c0a8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:00.823481 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-cc39c91a-ac4e-4581-9c43-99497f8718c2 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:00.824115 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-cc39c91a-ac4e-4581-9c43-99497f8718c2 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1e6f9976-8df1-4719-a873-ab83b056f95e] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:00.826053 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_cell0:SELECT=4 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:00:00.832385 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-cc39c91a-ac4e-4581-9c43-99497f8718c2 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:00.832829 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-cc39c91a-ac4e-4581-9c43-99497f8718c2 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:00.833886 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-cc39c91a-ac4e-4581-9c43-99497f8718c2 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:00.834518 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-cc39c91a-ac4e-4581-9c43-99497f8718c2 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:00.963975 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-0eaf914d-a647-4166-9810-f9d00b88c0a8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:00.995404 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-0eaf914d-a647-4166-9810-f9d00b88c0a8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:00.997156 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-0eaf914d-a647-4166-9810-f9d00b88c0a8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:01.001237 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-0eaf914d-a647-4166-9810-f9d00b88c0a8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1406 microversion: 2.20 time: 0.375941 Jun 16 19:00:01.004808 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 39/79] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:00:00 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1406 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:00:01.054929 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-cc39c91a-ac4e-4581-9c43-99497f8718c2 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:01.064448 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-cc39c91a-ac4e-4581-9c43-99497f8718c2 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e" status: 200 len: 1322 microversion: 2.1 time: 0.246717 Jun 16 19:00:01.065298 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 41/80] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:00 2022] GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e => generated 1322 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:01.334343 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-69d76b5d-f5f8-4363-b78b-ffb78da66498 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:01.335058 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-69d76b5d-f5f8-4363-b78b-ffb78da66498 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] [instance: de7eb4c7-a555-44f0-84c2-428b23b31a2d] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:01.347868 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-69d76b5d-f5f8-4363-b78b-ffb78da66498 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:01.348749 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-69d76b5d-f5f8-4363-b78b-ffb78da66498 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:01.350465 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-69d76b5d-f5f8-4363-b78b-ffb78da66498 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:01.351433 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-69d76b5d-f5f8-4363-b78b-ffb78da66498 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:01.447873 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-47b4f088-07a0-448b-9415-189c04e60ee1 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:01.449207 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-47b4f088-07a0-448b-9415-189c04e60ee1 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:01.458963 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-47b4f088-07a0-448b-9415-189c04e60ee1 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:01.459435 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-47b4f088-07a0-448b-9415-189c04e60ee1 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:01.460389 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-47b4f088-07a0-448b-9415-189c04e60ee1 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:01.461171 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-47b4f088-07a0-448b-9415-189c04e60ee1 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:01.523766 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-69d76b5d-f5f8-4363-b78b-ffb78da66498 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8813b3f6f8c46519fb827cf521bb37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de0652519d3447b8d0e4d948610071f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:01.531931 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-69d76b5d-f5f8-4363-b78b-ffb78da66498 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] 10.222.0.70 "GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d" status: 200 len: 1315 microversion: 2.1 time: 0.205911 Jun 16 19:00:01.532799 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 40/81] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:01 2022] GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:01.630221 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-47b4f088-07a0-448b-9415-189c04e60ee1 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:01.632438 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_cell1:SELECT=100 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:00:01.639497 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-47b4f088-07a0-448b-9415-189c04e60ee1 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1362 microversion: 2.1 time: 0.198120 Jun 16 19:00:01.640076 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 42/82] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:01 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1362 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:02.026723 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-432c8d25-1eb2-4469-ad4e-f00a0f482d81 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:02.027567 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-432c8d25-1eb2-4469-ad4e-f00a0f482d81 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:02.029848 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_cell0:SELECT=4 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:00:02.041989 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-432c8d25-1eb2-4469-ad4e-f00a0f482d81 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:02.042531 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-432c8d25-1eb2-4469-ad4e-f00a0f482d81 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:02.043870 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-432c8d25-1eb2-4469-ad4e-f00a0f482d81 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:02.044352 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-432c8d25-1eb2-4469-ad4e-f00a0f482d81 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:02.083189 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-59fb7950-da4d-4808-855b-da30f323c5f7 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:02.083960 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-59fb7950-da4d-4808-855b-da30f323c5f7 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1e6f9976-8df1-4719-a873-ab83b056f95e] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:02.102064 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-59fb7950-da4d-4808-855b-da30f323c5f7 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:02.104723 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-59fb7950-da4d-4808-855b-da30f323c5f7 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:02.108140 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-59fb7950-da4d-4808-855b-da30f323c5f7 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:02.110124 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-59fb7950-da4d-4808-855b-da30f323c5f7 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:02.349608 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-432c8d25-1eb2-4469-ad4e-f00a0f482d81 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:02.361572 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-432c8d25-1eb2-4469-ad4e-f00a0f482d81 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:02.363725 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-432c8d25-1eb2-4469-ad4e-f00a0f482d81 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:02.365151 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-432c8d25-1eb2-4469-ad4e-f00a0f482d81 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1406 microversion: 2.20 time: 0.344419 Jun 16 19:00:02.377206 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 41/83] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:00:02 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1406 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:00:02.551450 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-30f8cb3d-ea8d-4d2e-acd1-63058b75df2a tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:02.552409 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-30f8cb3d-ea8d-4d2e-acd1-63058b75df2a tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] [instance: de7eb4c7-a555-44f0-84c2-428b23b31a2d] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:02.562490 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-30f8cb3d-ea8d-4d2e-acd1-63058b75df2a tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:02.563231 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-30f8cb3d-ea8d-4d2e-acd1-63058b75df2a tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:02.564164 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-30f8cb3d-ea8d-4d2e-acd1-63058b75df2a tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:02.564877 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-30f8cb3d-ea8d-4d2e-acd1-63058b75df2a tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:02.702530 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-59fb7950-da4d-4808-855b-da30f323c5f7 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:02.720494 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-59fb7950-da4d-4808-855b-da30f323c5f7 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e" status: 200 len: 1322 microversion: 2.1 time: 0.638897 Jun 16 19:00:02.727876 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 43/84] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:02 2022] GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e => generated 1322 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:02.738727 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-51c21935-2c97-430e-bfff-b626d8c13d0a tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:02.745933 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-51c21935-2c97-430e-bfff-b626d8c13d0a tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:02.769062 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-51c21935-2c97-430e-bfff-b626d8c13d0a tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:02.769661 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-51c21935-2c97-430e-bfff-b626d8c13d0a tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:02.778900 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-51c21935-2c97-430e-bfff-b626d8c13d0a tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:02.779556 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-51c21935-2c97-430e-bfff-b626d8c13d0a tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:02.854977 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-30f8cb3d-ea8d-4d2e-acd1-63058b75df2a tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8813b3f6f8c46519fb827cf521bb37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de0652519d3447b8d0e4d948610071f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:02.869435 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-30f8cb3d-ea8d-4d2e-acd1-63058b75df2a tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] 10.222.0.70 "GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d" status: 200 len: 1315 microversion: 2.1 time: 0.323831 Jun 16 19:00:02.871186 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 42/85] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:02 2022] GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d => generated 1315 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:00:03.165551 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-51c21935-2c97-430e-bfff-b626d8c13d0a tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:03.175186 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-51c21935-2c97-430e-bfff-b626d8c13d0a tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1362 microversion: 2.1 time: 0.445960 Jun 16 19:00:03.186164 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 44/86] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:02 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1362 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:03.208968 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [req-c2fb4d5c-0e84-44fc-a0e3-ed9cc87cab29 req-af90ef72-de7b-46e3-b3c0-249713e90431 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1407f346-2c64-41d0-b983-268e60273230", "name": "network-vif-plugged", "status": "completed", "tag": "52a8ab2b-91b4-4c2c-b7aa-df9981b16adf"}]} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:00:03.231546 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-c2fb4d5c-0e84-44fc-a0e3-ed9cc87cab29 req-af90ef72-de7b-46e3-b3c0-249713e90431 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:03.235491 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-c2fb4d5c-0e84-44fc-a0e3-ed9cc87cab29 req-af90ef72-de7b-46e3-b3c0-249713e90431 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:03.263838 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.compute.server_external_events [req-c2fb4d5c-0e84-44fc-a0e3-ed9cc87cab29 req-af90ef72-de7b-46e3-b3c0-249713e90431 service nova] Creating event network-vif-plugged:52a8ab2b-91b4-4c2c-b7aa-df9981b16adf for instance 1407f346-2c64-41d0-b983-268e60273230 on hv-cinder-84617 Jun 16 19:00:03.282194 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [req-c2fb4d5c-0e84-44fc-a0e3-ed9cc87cab29 req-af90ef72-de7b-46e3-b3c0-249713e90431 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079484 Jun 16 19:00:03.282883 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 43/87] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:00:03.383938 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-e5117059-9e6d-46bb-8383-66d775450d9f tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:03.384773 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-e5117059-9e6d-46bb-8383-66d775450d9f tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:03.398942 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-e5117059-9e6d-46bb-8383-66d775450d9f tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:03.399596 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-e5117059-9e6d-46bb-8383-66d775450d9f tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:03.400546 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-e5117059-9e6d-46bb-8383-66d775450d9f tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:03.401395 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-e5117059-9e6d-46bb-8383-66d775450d9f tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:03.747110 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-97d0d48d-f9bc-47b4-a4ba-354367bbc57a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:03.748920 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-97d0d48d-f9bc-47b4-a4ba-354367bbc57a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1e6f9976-8df1-4719-a873-ab83b056f95e] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:03.769142 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-97d0d48d-f9bc-47b4-a4ba-354367bbc57a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:03.770260 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-97d0d48d-f9bc-47b4-a4ba-354367bbc57a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:03.774459 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-97d0d48d-f9bc-47b4-a4ba-354367bbc57a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:03.777701 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-97d0d48d-f9bc-47b4-a4ba-354367bbc57a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:03.803223 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-e5117059-9e6d-46bb-8383-66d775450d9f tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:03.820055 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-e5117059-9e6d-46bb-8383-66d775450d9f tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:03.825332 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-e5117059-9e6d-46bb-8383-66d775450d9f tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:03.828887 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-e5117059-9e6d-46bb-8383-66d775450d9f tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1406 microversion: 2.20 time: 0.448604 Jun 16 19:00:03.831566 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 45/88] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:00:03 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1406 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:00:03.893513 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-2b688def-13df-416f-bb77-2ef56b7b68bc tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:03.893847 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-2b688def-13df-416f-bb77-2ef56b7b68bc tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] [instance: de7eb4c7-a555-44f0-84c2-428b23b31a2d] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:03.905157 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-2b688def-13df-416f-bb77-2ef56b7b68bc tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:03.906743 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-2b688def-13df-416f-bb77-2ef56b7b68bc tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:03.907891 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-2b688def-13df-416f-bb77-2ef56b7b68bc tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:03.908645 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-2b688def-13df-416f-bb77-2ef56b7b68bc tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:03.994972 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-97d0d48d-f9bc-47b4-a4ba-354367bbc57a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:04.006025 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-97d0d48d-f9bc-47b4-a4ba-354367bbc57a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e" status: 200 len: 1322 microversion: 2.1 time: 0.263391 Jun 16 19:00:04.007639 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 44/89] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:03 2022] GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e => generated 1322 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:04.156730 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-2b688def-13df-416f-bb77-2ef56b7b68bc tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8813b3f6f8c46519fb827cf521bb37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de0652519d3447b8d0e4d948610071f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:04.168867 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-2b688def-13df-416f-bb77-2ef56b7b68bc tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] 10.222.0.70 "GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d" status: 200 len: 1315 microversion: 2.1 time: 0.282995 Jun 16 19:00:04.170874 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 46/90] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:03 2022] GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d => generated 1315 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:04.198981 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-7866ca6b-7e2a-4d49-8413-fc53bdc7e54c tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:04.200043 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-7866ca6b-7e2a-4d49-8413-fc53bdc7e54c tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:04.209904 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-7866ca6b-7e2a-4d49-8413-fc53bdc7e54c tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:04.210440 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-7866ca6b-7e2a-4d49-8413-fc53bdc7e54c tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:04.211229 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-7866ca6b-7e2a-4d49-8413-fc53bdc7e54c tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:04.211669 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-7866ca6b-7e2a-4d49-8413-fc53bdc7e54c tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:04.368988 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-7866ca6b-7e2a-4d49-8413-fc53bdc7e54c tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:04.378026 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-7866ca6b-7e2a-4d49-8413-fc53bdc7e54c tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1362 microversion: 2.1 time: 0.184792 Jun 16 19:00:04.378880 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 45/91] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:04 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:04.849767 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-790b4d30-be76-40b1-ba52-6bf3ba34da1d tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:04.850499 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-790b4d30-be76-40b1-ba52-6bf3ba34da1d tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:04.856745 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-790b4d30-be76-40b1-ba52-6bf3ba34da1d tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:04.857188 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-790b4d30-be76-40b1-ba52-6bf3ba34da1d tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:04.857947 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-790b4d30-be76-40b1-ba52-6bf3ba34da1d tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:04.858372 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-790b4d30-be76-40b1-ba52-6bf3ba34da1d tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:05.003617 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-790b4d30-be76-40b1-ba52-6bf3ba34da1d tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:05.011771 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-790b4d30-be76-40b1-ba52-6bf3ba34da1d tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:05.013275 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-790b4d30-be76-40b1-ba52-6bf3ba34da1d tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:05.014745 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-790b4d30-be76-40b1-ba52-6bf3ba34da1d tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1406 microversion: 2.20 time: 0.169146 Jun 16 19:00:05.022744 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 47/92] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:00:04 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:00:05.027932 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-d03cfa13-9127-4c77-b524-04aa12ff12cd tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:05.028560 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-d03cfa13-9127-4c77-b524-04aa12ff12cd tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1e6f9976-8df1-4719-a873-ab83b056f95e] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:05.035885 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d03cfa13-9127-4c77-b524-04aa12ff12cd tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:05.036395 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d03cfa13-9127-4c77-b524-04aa12ff12cd tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:05.037277 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d03cfa13-9127-4c77-b524-04aa12ff12cd tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:05.037749 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d03cfa13-9127-4c77-b524-04aa12ff12cd tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:05.189395 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-5ebd459a-2a4d-457b-8589-b6db523d88ea tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:05.190221 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-5ebd459a-2a4d-457b-8589-b6db523d88ea tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] [instance: de7eb4c7-a555-44f0-84c2-428b23b31a2d] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:05.196402 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-5ebd459a-2a4d-457b-8589-b6db523d88ea tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:05.196936 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-5ebd459a-2a4d-457b-8589-b6db523d88ea tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:05.197597 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-5ebd459a-2a4d-457b-8589-b6db523d88ea tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:05.198027 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-5ebd459a-2a4d-457b-8589-b6db523d88ea tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:05.218865 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-d03cfa13-9127-4c77-b524-04aa12ff12cd tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:05.223522 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_cell1:SELECT=100 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:00:05.231745 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-d03cfa13-9127-4c77-b524-04aa12ff12cd tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e" status: 200 len: 1322 microversion: 2.1 time: 0.210514 Jun 16 19:00:05.245142 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 46/93] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:05 2022] GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:05.303575 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [req-9b3e9d4e-441b-4269-b520-2eb991b13dc9 req-81138908-875b-415a-84bb-9ab716cd65af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e6f9976-8df1-4719-a873-ab83b056f95e", "name": "network-vif-plugged", "status": "completed", "tag": "00684661-7e70-4475-bd72-3ea8303e4612"}]} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:00:05.312707 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-9b3e9d4e-441b-4269-b520-2eb991b13dc9 req-81138908-875b-415a-84bb-9ab716cd65af service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:05.313236 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-9b3e9d4e-441b-4269-b520-2eb991b13dc9 req-81138908-875b-415a-84bb-9ab716cd65af service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:05.325044 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.compute.server_external_events [req-9b3e9d4e-441b-4269-b520-2eb991b13dc9 req-81138908-875b-415a-84bb-9ab716cd65af service nova] Creating event network-vif-plugged:00684661-7e70-4475-bd72-3ea8303e4612 for instance 1e6f9976-8df1-4719-a873-ab83b056f95e on hv-cinder-84617 Jun 16 19:00:05.330340 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [req-9b3e9d4e-441b-4269-b520-2eb991b13dc9 req-81138908-875b-415a-84bb-9ab716cd65af service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030381 Jun 16 19:00:05.330982 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 47/94] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:00:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:00:05.347562 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-5ebd459a-2a4d-457b-8589-b6db523d88ea tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8813b3f6f8c46519fb827cf521bb37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de0652519d3447b8d0e4d948610071f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:05.355560 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-5ebd459a-2a4d-457b-8589-b6db523d88ea tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] 10.222.0.70 "GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d" status: 200 len: 1315 microversion: 2.1 time: 0.170871 Jun 16 19:00:05.356166 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 48/95] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:05 2022] GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:00:05.396593 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-75d181b4-1933-47f0-8905-105e53e58f8c tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:05.397213 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-75d181b4-1933-47f0-8905-105e53e58f8c tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:05.404252 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-75d181b4-1933-47f0-8905-105e53e58f8c tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:05.404879 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-75d181b4-1933-47f0-8905-105e53e58f8c tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:05.405726 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-75d181b4-1933-47f0-8905-105e53e58f8c tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:05.406332 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-75d181b4-1933-47f0-8905-105e53e58f8c tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:05.551482 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-75d181b4-1933-47f0-8905-105e53e58f8c tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:05.559377 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-75d181b4-1933-47f0-8905-105e53e58f8c tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1362 microversion: 2.1 time: 0.167349 Jun 16 19:00:05.559949 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 48/96] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:05 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:06.032831 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-69e00369-72bf-46fe-9fa5-b8965a53c5dc tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:06.034172 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-69e00369-72bf-46fe-9fa5-b8965a53c5dc tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:06.040390 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-69e00369-72bf-46fe-9fa5-b8965a53c5dc tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:06.040840 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-69e00369-72bf-46fe-9fa5-b8965a53c5dc tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:06.041631 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-69e00369-72bf-46fe-9fa5-b8965a53c5dc tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:06.042062 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-69e00369-72bf-46fe-9fa5-b8965a53c5dc tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:06.190994 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-69e00369-72bf-46fe-9fa5-b8965a53c5dc tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:06.198971 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-69e00369-72bf-46fe-9fa5-b8965a53c5dc tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:06.200530 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-69e00369-72bf-46fe-9fa5-b8965a53c5dc tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:06.201579 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-69e00369-72bf-46fe-9fa5-b8965a53c5dc tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1406 microversion: 2.20 time: 0.172820 Jun 16 19:00:06.202138 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 49/97] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:00:06 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:00:06.259826 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-2487f99f-db93-4314-b915-6f73033f1b41 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:06.261496 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-2487f99f-db93-4314-b915-6f73033f1b41 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1e6f9976-8df1-4719-a873-ab83b056f95e] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:06.269337 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-2487f99f-db93-4314-b915-6f73033f1b41 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:06.269791 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-2487f99f-db93-4314-b915-6f73033f1b41 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:06.270564 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-2487f99f-db93-4314-b915-6f73033f1b41 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:06.271103 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-2487f99f-db93-4314-b915-6f73033f1b41 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:06.373549 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-52095b21-6186-486c-ab42-edfc2cc9de89 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:06.375584 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-52095b21-6186-486c-ab42-edfc2cc9de89 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] [instance: de7eb4c7-a555-44f0-84c2-428b23b31a2d] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:06.382398 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-52095b21-6186-486c-ab42-edfc2cc9de89 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:06.382934 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-52095b21-6186-486c-ab42-edfc2cc9de89 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:06.383734 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-52095b21-6186-486c-ab42-edfc2cc9de89 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:06.384214 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-52095b21-6186-486c-ab42-edfc2cc9de89 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:06.433144 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-2487f99f-db93-4314-b915-6f73033f1b41 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:06.443197 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-2487f99f-db93-4314-b915-6f73033f1b41 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e" status: 200 len: 1322 microversion: 2.1 time: 0.191201 Jun 16 19:00:06.443785 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 49/98] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:06 2022] GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e => generated 1322 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:06.533745 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-52095b21-6186-486c-ab42-edfc2cc9de89 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8813b3f6f8c46519fb827cf521bb37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de0652519d3447b8d0e4d948610071f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:06.541744 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-52095b21-6186-486c-ab42-edfc2cc9de89 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] 10.222.0.70 "GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d" status: 200 len: 1315 microversion: 2.1 time: 0.172069 Jun 16 19:00:06.542321 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 50/99] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:06 2022] GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:00:06.576763 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-046d554a-3efa-4ba6-b581-7894167d124b tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:06.577375 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-046d554a-3efa-4ba6-b581-7894167d124b tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:06.584253 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-046d554a-3efa-4ba6-b581-7894167d124b tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:06.584700 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-046d554a-3efa-4ba6-b581-7894167d124b tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:06.585458 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-046d554a-3efa-4ba6-b581-7894167d124b tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:06.585893 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-046d554a-3efa-4ba6-b581-7894167d124b tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:06.760306 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-046d554a-3efa-4ba6-b581-7894167d124b tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:06.768509 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-046d554a-3efa-4ba6-b581-7894167d124b tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1362 microversion: 2.1 time: 0.195593 Jun 16 19:00:06.769317 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 50/100] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:06 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1362 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:07.221577 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-a9f9ae74-2ae5-4c76-ae3b-8282f02b34e5 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:07.222177 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-a9f9ae74-2ae5-4c76-ae3b-8282f02b34e5 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:07.228747 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-a9f9ae74-2ae5-4c76-ae3b-8282f02b34e5 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:07.229204 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-a9f9ae74-2ae5-4c76-ae3b-8282f02b34e5 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:07.229969 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-a9f9ae74-2ae5-4c76-ae3b-8282f02b34e5 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:07.230412 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-a9f9ae74-2ae5-4c76-ae3b-8282f02b34e5 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:07.357675 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [req-9c6fb1d0-37bb-4846-a773-111026de1333 req-1b0ad424-76ad-4ebf-ac34-c016907bfab9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c077a29-12e0-48af-a8b6-43d0b5a79bf4", "name": "network-vif-plugged", "status": "completed", "tag": "3e9e841e-467e-4321-a3d7-1999929bc359"}]} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:00:07.389689 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-9c6fb1d0-37bb-4846-a773-111026de1333 req-1b0ad424-76ad-4ebf-ac34-c016907bfab9 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:07.391098 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-9c6fb1d0-37bb-4846-a773-111026de1333 req-1b0ad424-76ad-4ebf-ac34-c016907bfab9 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:07.406752 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.compute.server_external_events [req-9c6fb1d0-37bb-4846-a773-111026de1333 req-1b0ad424-76ad-4ebf-ac34-c016907bfab9 service nova] Creating event network-vif-plugged:3e9e841e-467e-4321-a3d7-1999929bc359 for instance 1c077a29-12e0-48af-a8b6-43d0b5a79bf4 on hv-cinder-84617 Jun 16 19:00:07.412133 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [req-9c6fb1d0-37bb-4846-a773-111026de1333 req-1b0ad424-76ad-4ebf-ac34-c016907bfab9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059060 Jun 16 19:00:07.413047 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 51/101] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:00:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:00:07.465814 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-df598366-e57d-47e0-a4c3-15a1653110c1 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:07.466636 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-df598366-e57d-47e0-a4c3-15a1653110c1 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1e6f9976-8df1-4719-a873-ab83b056f95e] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:07.474859 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-df598366-e57d-47e0-a4c3-15a1653110c1 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:07.475494 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-df598366-e57d-47e0-a4c3-15a1653110c1 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:07.476369 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-df598366-e57d-47e0-a4c3-15a1653110c1 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:07.476982 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-df598366-e57d-47e0-a4c3-15a1653110c1 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:07.480686 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-a9f9ae74-2ae5-4c76-ae3b-8282f02b34e5 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:07.490623 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-a9f9ae74-2ae5-4c76-ae3b-8282f02b34e5 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:07.492138 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-a9f9ae74-2ae5-4c76-ae3b-8282f02b34e5 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:07.493327 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-a9f9ae74-2ae5-4c76-ae3b-8282f02b34e5 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1406 microversion: 2.20 time: 0.276900 Jun 16 19:00:07.493984 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 51/102] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:00:07 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1406 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:00:07.560078 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-b5056e9d-7b4f-402d-9ba2-70bcb28930d6 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:07.560581 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-b5056e9d-7b4f-402d-9ba2-70bcb28930d6 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] [instance: de7eb4c7-a555-44f0-84c2-428b23b31a2d] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:07.568248 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-b5056e9d-7b4f-402d-9ba2-70bcb28930d6 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:07.568488 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-b5056e9d-7b4f-402d-9ba2-70bcb28930d6 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:07.569251 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-b5056e9d-7b4f-402d-9ba2-70bcb28930d6 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:07.569679 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-b5056e9d-7b4f-402d-9ba2-70bcb28930d6 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:07.628920 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-df598366-e57d-47e0-a4c3-15a1653110c1 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:07.636409 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-df598366-e57d-47e0-a4c3-15a1653110c1 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e" status: 200 len: 1322 microversion: 2.1 time: 0.179365 Jun 16 19:00:07.636988 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 52/103] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:07 2022] GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e => generated 1322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:00:07.788069 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-105745ee-417a-4f6e-b19a-d74a03769188 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:07.788992 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-105745ee-417a-4f6e-b19a-d74a03769188 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:07.799287 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-105745ee-417a-4f6e-b19a-d74a03769188 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:07.800969 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-105745ee-417a-4f6e-b19a-d74a03769188 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:07.802419 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-105745ee-417a-4f6e-b19a-d74a03769188 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:07.803171 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-105745ee-417a-4f6e-b19a-d74a03769188 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:07.932043 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-b5056e9d-7b4f-402d-9ba2-70bcb28930d6 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8813b3f6f8c46519fb827cf521bb37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de0652519d3447b8d0e4d948610071f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:07.940648 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-b5056e9d-7b4f-402d-9ba2-70bcb28930d6 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] 10.222.0.70 "GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d" status: 200 len: 1315 microversion: 2.1 time: 0.384908 Jun 16 19:00:07.941660 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 52/104] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:07 2022] GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d => generated 1315 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:00:08.014225 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-105745ee-417a-4f6e-b19a-d74a03769188 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:08.022614 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-105745ee-417a-4f6e-b19a-d74a03769188 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1362 microversion: 2.1 time: 0.239742 Jun 16 19:00:08.023443 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 53/105] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:07 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1362 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:08.513201 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-8593b129-7ee1-4fce-8970-a7462c651389 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:08.514069 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-8593b129-7ee1-4fce-8970-a7462c651389 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:08.521618 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-8593b129-7ee1-4fce-8970-a7462c651389 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:08.522070 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-8593b129-7ee1-4fce-8970-a7462c651389 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:08.522879 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-8593b129-7ee1-4fce-8970-a7462c651389 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:08.523304 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-8593b129-7ee1-4fce-8970-a7462c651389 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:08.653506 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-88808fe4-848f-4f2b-b31f-44c862057a99 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:08.654143 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-88808fe4-848f-4f2b-b31f-44c862057a99 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1e6f9976-8df1-4719-a873-ab83b056f95e] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:08.661885 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-88808fe4-848f-4f2b-b31f-44c862057a99 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:08.662268 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-88808fe4-848f-4f2b-b31f-44c862057a99 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:08.662382 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-8593b129-7ee1-4fce-8970-a7462c651389 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:08.663056 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-88808fe4-848f-4f2b-b31f-44c862057a99 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:08.663482 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-88808fe4-848f-4f2b-b31f-44c862057a99 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:08.670913 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-8593b129-7ee1-4fce-8970-a7462c651389 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:08.672884 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-8593b129-7ee1-4fce-8970-a7462c651389 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:08.674001 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-8593b129-7ee1-4fce-8970-a7462c651389 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1406 microversion: 2.20 time: 0.165246 Jun 16 19:00:08.674561 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 53/106] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:00:08 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:00:08.958497 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-f9db9361-0087-45d8-9594-d4e87f1a0f3d tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:08.959176 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-f9db9361-0087-45d8-9594-d4e87f1a0f3d tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] [instance: de7eb4c7-a555-44f0-84c2-428b23b31a2d] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:08.966607 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f9db9361-0087-45d8-9594-d4e87f1a0f3d tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:08.966607 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f9db9361-0087-45d8-9594-d4e87f1a0f3d tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:08.966955 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f9db9361-0087-45d8-9594-d4e87f1a0f3d tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:08.967276 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f9db9361-0087-45d8-9594-d4e87f1a0f3d tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:08.984595 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-88808fe4-848f-4f2b-b31f-44c862057a99 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:08.992245 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-88808fe4-848f-4f2b-b31f-44c862057a99 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e" status: 200 len: 1322 microversion: 2.1 time: 0.342791 Jun 16 19:00:08.992787 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 54/107] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:08 2022] GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e => generated 1322 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:00:09.040684 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-0ccf2e43-a8fa-4156-81e7-ef2c5a78e8fe tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:09.041340 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-0ccf2e43-a8fa-4156-81e7-ef2c5a78e8fe tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:09.054161 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0ccf2e43-a8fa-4156-81e7-ef2c5a78e8fe tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:09.054988 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0ccf2e43-a8fa-4156-81e7-ef2c5a78e8fe tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:09.055953 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0ccf2e43-a8fa-4156-81e7-ef2c5a78e8fe tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:09.056423 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0ccf2e43-a8fa-4156-81e7-ef2c5a78e8fe tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:09.107395 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-f9db9361-0087-45d8-9594-d4e87f1a0f3d tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8813b3f6f8c46519fb827cf521bb37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de0652519d3447b8d0e4d948610071f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:09.115610 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-f9db9361-0087-45d8-9594-d4e87f1a0f3d tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] 10.222.0.70 "GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d" status: 200 len: 1315 microversion: 2.1 time: 0.161772 Jun 16 19:00:09.116180 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 54/108] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:08 2022] GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:00:09.194792 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-0ccf2e43-a8fa-4156-81e7-ef2c5a78e8fe tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:09.202064 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-0ccf2e43-a8fa-4156-81e7-ef2c5a78e8fe tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1362 microversion: 2.1 time: 0.165619 Jun 16 19:00:09.202806 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 55/109] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:09 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:00:09.693656 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-a3fd167a-2dcc-4d37-9e24-7b197289d03b tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:09.694459 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-a3fd167a-2dcc-4d37-9e24-7b197289d03b tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:09.701877 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-a3fd167a-2dcc-4d37-9e24-7b197289d03b tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:09.702437 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-a3fd167a-2dcc-4d37-9e24-7b197289d03b tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:09.703543 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-a3fd167a-2dcc-4d37-9e24-7b197289d03b tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:09.703980 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-a3fd167a-2dcc-4d37-9e24-7b197289d03b tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:09.834751 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-a3fd167a-2dcc-4d37-9e24-7b197289d03b tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:09.844090 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-a3fd167a-2dcc-4d37-9e24-7b197289d03b tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:09.845999 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-a3fd167a-2dcc-4d37-9e24-7b197289d03b tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:09.847608 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-a3fd167a-2dcc-4d37-9e24-7b197289d03b tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1406 microversion: 2.20 time: 0.159193 Jun 16 19:00:09.851475 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 55/110] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:00:09 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:00:10.009542 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-b235b294-068c-4fbd-8047-f254fd5b0faa tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:10.010140 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-b235b294-068c-4fbd-8047-f254fd5b0faa tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1e6f9976-8df1-4719-a873-ab83b056f95e] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:10.016455 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b235b294-068c-4fbd-8047-f254fd5b0faa tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:10.016893 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b235b294-068c-4fbd-8047-f254fd5b0faa tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:10.017644 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b235b294-068c-4fbd-8047-f254fd5b0faa tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:10.018071 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b235b294-068c-4fbd-8047-f254fd5b0faa tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:10.133211 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-06a4234a-3724-4c60-ac6e-1daed9e59c55 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:10.133919 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-06a4234a-3724-4c60-ac6e-1daed9e59c55 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] [instance: de7eb4c7-a555-44f0-84c2-428b23b31a2d] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:10.140044 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-06a4234a-3724-4c60-ac6e-1daed9e59c55 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:10.140595 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-06a4234a-3724-4c60-ac6e-1daed9e59c55 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:10.141432 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-06a4234a-3724-4c60-ac6e-1daed9e59c55 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:10.141871 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-06a4234a-3724-4c60-ac6e-1daed9e59c55 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:10.153787 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-b235b294-068c-4fbd-8047-f254fd5b0faa tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:10.161813 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-b235b294-068c-4fbd-8047-f254fd5b0faa tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e" status: 200 len: 1322 microversion: 2.1 time: 0.156159 Jun 16 19:00:10.162383 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 56/111] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:10 2022] GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:10.219903 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-d861561a-2ede-487f-8acb-00417f50b67d tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:10.220517 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-d861561a-2ede-487f-8acb-00417f50b67d tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:10.226478 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d861561a-2ede-487f-8acb-00417f50b67d tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:10.226959 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d861561a-2ede-487f-8acb-00417f50b67d tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:10.227716 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d861561a-2ede-487f-8acb-00417f50b67d tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:10.228154 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d861561a-2ede-487f-8acb-00417f50b67d tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:10.279927 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-06a4234a-3724-4c60-ac6e-1daed9e59c55 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8813b3f6f8c46519fb827cf521bb37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de0652519d3447b8d0e4d948610071f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:10.288624 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-06a4234a-3724-4c60-ac6e-1daed9e59c55 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] 10.222.0.70 "GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d" status: 200 len: 1315 microversion: 2.1 time: 0.159253 Jun 16 19:00:10.289187 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 56/112] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:10 2022] GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:00:10.357887 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-d861561a-2ede-487f-8acb-00417f50b67d tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:10.366214 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-d861561a-2ede-487f-8acb-00417f50b67d tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1362 microversion: 2.1 time: 0.150890 Jun 16 19:00:10.366802 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 57/113] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:10 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:00:10.867986 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-9db330a2-b7ff-43e9-9e6a-134bf433ba96 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:10.869309 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-9db330a2-b7ff-43e9-9e6a-134bf433ba96 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:10.876976 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-9db330a2-b7ff-43e9-9e6a-134bf433ba96 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:10.877425 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-9db330a2-b7ff-43e9-9e6a-134bf433ba96 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:10.878295 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-9db330a2-b7ff-43e9-9e6a-134bf433ba96 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:10.878754 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-9db330a2-b7ff-43e9-9e6a-134bf433ba96 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:11.017341 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-9db330a2-b7ff-43e9-9e6a-134bf433ba96 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:11.025336 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-9db330a2-b7ff-43e9-9e6a-134bf433ba96 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:11.027187 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-9db330a2-b7ff-43e9-9e6a-134bf433ba96 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:11.028292 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-9db330a2-b7ff-43e9-9e6a-134bf433ba96 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1406 microversion: 2.20 time: 0.164248 Jun 16 19:00:11.028849 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 57/114] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:00:10 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:00:11.178436 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-513e0531-8838-4073-a141-7840cea6bde3 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:11.179126 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-513e0531-8838-4073-a141-7840cea6bde3 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1e6f9976-8df1-4719-a873-ab83b056f95e] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:11.185462 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-513e0531-8838-4073-a141-7840cea6bde3 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:11.185911 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-513e0531-8838-4073-a141-7840cea6bde3 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:11.186718 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-513e0531-8838-4073-a141-7840cea6bde3 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:11.187300 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-513e0531-8838-4073-a141-7840cea6bde3 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:11.305201 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-c4f43151-43f6-44da-a3bc-c182670664df tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:11.305813 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-c4f43151-43f6-44da-a3bc-c182670664df tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] [instance: de7eb4c7-a555-44f0-84c2-428b23b31a2d] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:11.313356 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-c4f43151-43f6-44da-a3bc-c182670664df tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:11.313806 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-c4f43151-43f6-44da-a3bc-c182670664df tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:11.314583 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-c4f43151-43f6-44da-a3bc-c182670664df tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:11.315028 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-c4f43151-43f6-44da-a3bc-c182670664df tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:11.325786 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-513e0531-8838-4073-a141-7840cea6bde3 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:11.333611 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-513e0531-8838-4073-a141-7840cea6bde3 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e" status: 200 len: 1322 microversion: 2.1 time: 0.159080 Jun 16 19:00:11.334270 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 58/115] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:11 2022] GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:11.385261 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-cacc68e5-8e89-4cb9-b130-56bd206fd871 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:11.385789 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-cacc68e5-8e89-4cb9-b130-56bd206fd871 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:11.391909 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-cacc68e5-8e89-4cb9-b130-56bd206fd871 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:11.392353 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-cacc68e5-8e89-4cb9-b130-56bd206fd871 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:11.393122 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-cacc68e5-8e89-4cb9-b130-56bd206fd871 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:11.393537 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-cacc68e5-8e89-4cb9-b130-56bd206fd871 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:11.447982 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-c4f43151-43f6-44da-a3bc-c182670664df tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8813b3f6f8c46519fb827cf521bb37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de0652519d3447b8d0e4d948610071f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:11.455941 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-c4f43151-43f6-44da-a3bc-c182670664df tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] 10.222.0.70 "GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d" status: 200 len: 1502 microversion: 2.1 time: 0.154564 Jun 16 19:00:11.456938 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 58/116] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:11 2022] GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d => generated 1502 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:00:11.534649 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-cacc68e5-8e89-4cb9-b130-56bd206fd871 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:11.542509 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-cacc68e5-8e89-4cb9-b130-56bd206fd871 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1362 microversion: 2.1 time: 0.162356 Jun 16 19:00:11.543511 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 59/117] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:11 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:00:12.049040 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-cdf3d09c-7543-4a3d-96d2-f5deac783c94 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:12.049652 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-cdf3d09c-7543-4a3d-96d2-f5deac783c94 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:12.055651 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-cdf3d09c-7543-4a3d-96d2-f5deac783c94 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:12.056104 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-cdf3d09c-7543-4a3d-96d2-f5deac783c94 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:12.056859 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-cdf3d09c-7543-4a3d-96d2-f5deac783c94 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:12.057289 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-cdf3d09c-7543-4a3d-96d2-f5deac783c94 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:12.072544 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_cell1:SELECT=100 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:00:12.196328 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-cdf3d09c-7543-4a3d-96d2-f5deac783c94 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:12.204885 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-cdf3d09c-7543-4a3d-96d2-f5deac783c94 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:12.206378 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-cdf3d09c-7543-4a3d-96d2-f5deac783c94 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:12.207511 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-cdf3d09c-7543-4a3d-96d2-f5deac783c94 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1406 microversion: 2.20 time: 0.162744 Jun 16 19:00:12.208060 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 59/118] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:00:12 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:00:12.351076 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-6f34b6df-cb5a-4677-bd18-10772c3d39fc tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:12.351697 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-6f34b6df-cb5a-4677-bd18-10772c3d39fc tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1e6f9976-8df1-4719-a873-ab83b056f95e] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:12.358535 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-6f34b6df-cb5a-4677-bd18-10772c3d39fc tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:12.359703 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-6f34b6df-cb5a-4677-bd18-10772c3d39fc tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:12.360614 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-6f34b6df-cb5a-4677-bd18-10772c3d39fc tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:12.361048 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-6f34b6df-cb5a-4677-bd18-10772c3d39fc tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:12.500690 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-6f34b6df-cb5a-4677-bd18-10772c3d39fc tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:12.508118 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-6f34b6df-cb5a-4677-bd18-10772c3d39fc tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e" status: 200 len: 1322 microversion: 2.1 time: 0.160949 Jun 16 19:00:12.508672 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 60/119] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:12 2022] GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:00:12.559794 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-7b84f4c9-a6c6-4cc3-96db-ca52ac3061af tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:12.560414 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-7b84f4c9-a6c6-4cc3-96db-ca52ac3061af tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:12.566901 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-7b84f4c9-a6c6-4cc3-96db-ca52ac3061af tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:12.567352 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-7b84f4c9-a6c6-4cc3-96db-ca52ac3061af tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:12.568119 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-7b84f4c9-a6c6-4cc3-96db-ca52ac3061af tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:12.568558 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-7b84f4c9-a6c6-4cc3-96db-ca52ac3061af tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:12.695793 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-7b84f4c9-a6c6-4cc3-96db-ca52ac3061af tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:12.703955 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-7b84f4c9-a6c6-4cc3-96db-ca52ac3061af tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1362 microversion: 2.1 time: 0.148018 Jun 16 19:00:12.704527 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 60/120] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:12 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:13.225637 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-8322dc3f-a54a-4fe9-87db-7f7e829c9749 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:13.226164 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-8322dc3f-a54a-4fe9-87db-7f7e829c9749 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:13.232279 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-8322dc3f-a54a-4fe9-87db-7f7e829c9749 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:13.232729 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-8322dc3f-a54a-4fe9-87db-7f7e829c9749 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:13.233610 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-8322dc3f-a54a-4fe9-87db-7f7e829c9749 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:13.234614 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-8322dc3f-a54a-4fe9-87db-7f7e829c9749 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:13.364834 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-8322dc3f-a54a-4fe9-87db-7f7e829c9749 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:13.372826 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-8322dc3f-a54a-4fe9-87db-7f7e829c9749 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:13.374454 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-8322dc3f-a54a-4fe9-87db-7f7e829c9749 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:13.375728 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-8322dc3f-a54a-4fe9-87db-7f7e829c9749 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1406 microversion: 2.20 time: 0.154101 Jun 16 19:00:13.376291 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 61/121] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:00:13 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:00:13.526358 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-fd7a8fe2-b0c4-421c-9bc3-a3f84f0f78a3 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:13.526905 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-fd7a8fe2-b0c4-421c-9bc3-a3f84f0f78a3 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1e6f9976-8df1-4719-a873-ab83b056f95e] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:13.534335 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-fd7a8fe2-b0c4-421c-9bc3-a3f84f0f78a3 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:13.534818 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-fd7a8fe2-b0c4-421c-9bc3-a3f84f0f78a3 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:13.535694 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-fd7a8fe2-b0c4-421c-9bc3-a3f84f0f78a3 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:13.536132 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-fd7a8fe2-b0c4-421c-9bc3-a3f84f0f78a3 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:13.663431 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-fd7a8fe2-b0c4-421c-9bc3-a3f84f0f78a3 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:13.670874 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-fd7a8fe2-b0c4-421c-9bc3-a3f84f0f78a3 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e" status: 200 len: 1322 microversion: 2.1 time: 0.148698 Jun 16 19:00:13.671475 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 61/122] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:13 2022] GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:13.721189 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-3eadbd76-a421-4c72-ac61-23c2f6a3411a tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:13.721809 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-3eadbd76-a421-4c72-ac61-23c2f6a3411a tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:13.727913 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-3eadbd76-a421-4c72-ac61-23c2f6a3411a tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:13.728362 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-3eadbd76-a421-4c72-ac61-23c2f6a3411a tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:13.729126 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-3eadbd76-a421-4c72-ac61-23c2f6a3411a tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:13.729560 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-3eadbd76-a421-4c72-ac61-23c2f6a3411a tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:13.859145 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-3eadbd76-a421-4c72-ac61-23c2f6a3411a tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:13.866539 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-3eadbd76-a421-4c72-ac61-23c2f6a3411a tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1362 microversion: 2.1 time: 0.149840 Jun 16 19:00:13.867329 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 62/123] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:13 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:14.393833 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-aad3cb71-22ea-4952-9a12-8cb0cbe32ef6 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:14.394403 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-aad3cb71-22ea-4952-9a12-8cb0cbe32ef6 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:14.400793 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-aad3cb71-22ea-4952-9a12-8cb0cbe32ef6 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:14.401546 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-aad3cb71-22ea-4952-9a12-8cb0cbe32ef6 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:14.402361 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-aad3cb71-22ea-4952-9a12-8cb0cbe32ef6 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:14.402857 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-aad3cb71-22ea-4952-9a12-8cb0cbe32ef6 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:14.546980 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-aad3cb71-22ea-4952-9a12-8cb0cbe32ef6 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:14.556280 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-aad3cb71-22ea-4952-9a12-8cb0cbe32ef6 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:14.558066 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-aad3cb71-22ea-4952-9a12-8cb0cbe32ef6 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:14.559636 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-aad3cb71-22ea-4952-9a12-8cb0cbe32ef6 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1406 microversion: 2.20 time: 0.170161 Jun 16 19:00:14.560418 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 62/124] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:00:14 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:00:14.631698 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [req-fd4afdcf-b474-4e8d-9ec7-052e4c4f5624 req-da4de7f5-b3e8-430b-8401-c02518e55328 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fb4cc0a-23a8-417c-a8a1-35501c2690ee", "name": "network-vif-plugged", "status": "completed", "tag": "523e7a48-bea7-4e32-9e88-5f62ea569a81"}]} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:00:14.641479 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-fd4afdcf-b474-4e8d-9ec7-052e4c4f5624 req-da4de7f5-b3e8-430b-8401-c02518e55328 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:14.642175 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-fd4afdcf-b474-4e8d-9ec7-052e4c4f5624 req-da4de7f5-b3e8-430b-8401-c02518e55328 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:14.654909 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.compute.server_external_events [req-fd4afdcf-b474-4e8d-9ec7-052e4c4f5624 req-da4de7f5-b3e8-430b-8401-c02518e55328 service nova] Creating event network-vif-plugged:523e7a48-bea7-4e32-9e88-5f62ea569a81 for instance 2fb4cc0a-23a8-417c-a8a1-35501c2690ee on hv-cinder-84617 Jun 16 19:00:14.660459 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [req-fd4afdcf-b474-4e8d-9ec7-052e4c4f5624 req-da4de7f5-b3e8-430b-8401-c02518e55328 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033313 Jun 16 19:00:14.661083 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 63/125] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:00:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:00:14.688281 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-c2de5be2-3387-44cc-bb54-caee584d7611 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:14.688936 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-c2de5be2-3387-44cc-bb54-caee584d7611 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1e6f9976-8df1-4719-a873-ab83b056f95e] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:14.695449 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-c2de5be2-3387-44cc-bb54-caee584d7611 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:14.695902 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-c2de5be2-3387-44cc-bb54-caee584d7611 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:14.696672 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-c2de5be2-3387-44cc-bb54-caee584d7611 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:14.697159 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-c2de5be2-3387-44cc-bb54-caee584d7611 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:14.831621 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-c2de5be2-3387-44cc-bb54-caee584d7611 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:14.838978 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-c2de5be2-3387-44cc-bb54-caee584d7611 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e" status: 200 len: 1322 microversion: 2.1 time: 0.155208 Jun 16 19:00:14.839536 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 63/126] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:14 2022] GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:14.884189 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-cc44a902-02f6-4042-b090-def031981999 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:14.884889 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-cc44a902-02f6-4042-b090-def031981999 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:14.891807 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-cc44a902-02f6-4042-b090-def031981999 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:14.892249 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-cc44a902-02f6-4042-b090-def031981999 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:14.893017 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-cc44a902-02f6-4042-b090-def031981999 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:14.893448 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-cc44a902-02f6-4042-b090-def031981999 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:15.035702 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-cc44a902-02f6-4042-b090-def031981999 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:15.043159 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-cc44a902-02f6-4042-b090-def031981999 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1362 microversion: 2.1 time: 0.163364 Jun 16 19:00:15.043713 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 64/127] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:14 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:15.582717 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-584b9d6b-3bf4-4645-bdd4-6f060556fa25 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:15.583334 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-584b9d6b-3bf4-4645-bdd4-6f060556fa25 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:15.589542 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-584b9d6b-3bf4-4645-bdd4-6f060556fa25 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:15.589843 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-584b9d6b-3bf4-4645-bdd4-6f060556fa25 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:15.590626 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-584b9d6b-3bf4-4645-bdd4-6f060556fa25 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:15.591066 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-584b9d6b-3bf4-4645-bdd4-6f060556fa25 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:15.734823 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-584b9d6b-3bf4-4645-bdd4-6f060556fa25 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:15.742875 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-584b9d6b-3bf4-4645-bdd4-6f060556fa25 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:15.744434 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-584b9d6b-3bf4-4645-bdd4-6f060556fa25 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:15.745540 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-584b9d6b-3bf4-4645-bdd4-6f060556fa25 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1406 microversion: 2.20 time: 0.170888 Jun 16 19:00:15.746093 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 64/128] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:00:15 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:00:15.859727 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-98457b4c-af2f-427d-becd-958ef639e0b6 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:15.860438 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-98457b4c-af2f-427d-becd-958ef639e0b6 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1e6f9976-8df1-4719-a873-ab83b056f95e] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:15.868532 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-98457b4c-af2f-427d-becd-958ef639e0b6 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:15.869385 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-98457b4c-af2f-427d-becd-958ef639e0b6 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:15.872204 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-98457b4c-af2f-427d-becd-958ef639e0b6 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:15.873199 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-98457b4c-af2f-427d-becd-958ef639e0b6 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:15.896665 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_cell1:SELECT=100 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:00:16.028979 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-98457b4c-af2f-427d-becd-958ef639e0b6 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:16.036690 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-98457b4c-af2f-427d-becd-958ef639e0b6 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e" status: 200 len: 1322 microversion: 2.1 time: 0.183954 Jun 16 19:00:16.037243 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 65/129] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:15 2022] GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e => generated 1322 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:16.059802 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-6f4fe8ad-4b1e-458d-8500-423b272499a1 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:16.060417 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-6f4fe8ad-4b1e-458d-8500-423b272499a1 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:16.067561 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-6f4fe8ad-4b1e-458d-8500-423b272499a1 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:16.068007 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-6f4fe8ad-4b1e-458d-8500-423b272499a1 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:16.068761 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-6f4fe8ad-4b1e-458d-8500-423b272499a1 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:16.069191 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-6f4fe8ad-4b1e-458d-8500-423b272499a1 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:16.204820 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-6f4fe8ad-4b1e-458d-8500-423b272499a1 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:16.213060 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-6f4fe8ad-4b1e-458d-8500-423b272499a1 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1362 microversion: 2.1 time: 0.157065 Jun 16 19:00:16.213661 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 65/130] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:16 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:16.764004 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-cfb4694b-35c8-4c5d-9dd8-9fe622c5b6f5 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:16.764531 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-cfb4694b-35c8-4c5d-9dd8-9fe622c5b6f5 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:16.771443 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-cfb4694b-35c8-4c5d-9dd8-9fe622c5b6f5 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:16.771892 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-cfb4694b-35c8-4c5d-9dd8-9fe622c5b6f5 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:16.772653 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-cfb4694b-35c8-4c5d-9dd8-9fe622c5b6f5 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:16.773124 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-cfb4694b-35c8-4c5d-9dd8-9fe622c5b6f5 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:16.911896 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-cfb4694b-35c8-4c5d-9dd8-9fe622c5b6f5 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:16.920926 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-cfb4694b-35c8-4c5d-9dd8-9fe622c5b6f5 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:16.923587 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-cfb4694b-35c8-4c5d-9dd8-9fe622c5b6f5 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:16.924417 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-cfb4694b-35c8-4c5d-9dd8-9fe622c5b6f5 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1406 microversion: 2.20 time: 0.164423 Jun 16 19:00:16.925265 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 66/131] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:00:16 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:00:17.053309 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-835f8a95-0d4e-4a42-838d-8fd4dce8d5d0 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:17.053933 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-835f8a95-0d4e-4a42-838d-8fd4dce8d5d0 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1e6f9976-8df1-4719-a873-ab83b056f95e] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:17.060064 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-835f8a95-0d4e-4a42-838d-8fd4dce8d5d0 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:17.060517 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-835f8a95-0d4e-4a42-838d-8fd4dce8d5d0 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:17.061281 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-835f8a95-0d4e-4a42-838d-8fd4dce8d5d0 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:17.061797 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-835f8a95-0d4e-4a42-838d-8fd4dce8d5d0 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:17.195948 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-835f8a95-0d4e-4a42-838d-8fd4dce8d5d0 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:17.203619 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-835f8a95-0d4e-4a42-838d-8fd4dce8d5d0 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e" status: 200 len: 1322 microversion: 2.1 time: 0.154113 Jun 16 19:00:17.204208 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 66/132] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:17 2022] GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:17.230957 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-f2690aae-9431-46af-9479-847a32aa3100 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:17.231626 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-f2690aae-9431-46af-9479-847a32aa3100 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:17.238252 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-f2690aae-9431-46af-9479-847a32aa3100 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:17.238735 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-f2690aae-9431-46af-9479-847a32aa3100 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:17.239504 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-f2690aae-9431-46af-9479-847a32aa3100 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:17.239949 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-f2690aae-9431-46af-9479-847a32aa3100 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:17.371482 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-f2690aae-9431-46af-9479-847a32aa3100 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:17.380687 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-f2690aae-9431-46af-9479-847a32aa3100 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1362 microversion: 2.1 time: 0.153374 Jun 16 19:00:17.381524 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 67/133] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:17 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:17.943722 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-e8b21960-e077-432b-a64c-9c087006e660 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:17.944828 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-e8b21960-e077-432b-a64c-9c087006e660 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:17.953673 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-e8b21960-e077-432b-a64c-9c087006e660 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:17.954333 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-e8b21960-e077-432b-a64c-9c087006e660 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:17.955499 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-e8b21960-e077-432b-a64c-9c087006e660 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:17.956090 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-e8b21960-e077-432b-a64c-9c087006e660 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:18.107752 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-e8b21960-e077-432b-a64c-9c087006e660 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:18.117700 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-e8b21960-e077-432b-a64c-9c087006e660 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:18.119250 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-e8b21960-e077-432b-a64c-9c087006e660 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:18.120358 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-e8b21960-e077-432b-a64c-9c087006e660 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1406 microversion: 2.20 time: 0.180999 Jun 16 19:00:18.120905 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 67/134] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:00:17 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1406 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:00:18.221709 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-bf5d9233-e999-4db5-ab87-30e549425a20 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:18.223467 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-bf5d9233-e999-4db5-ab87-30e549425a20 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1e6f9976-8df1-4719-a873-ab83b056f95e] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:18.229474 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-bf5d9233-e999-4db5-ab87-30e549425a20 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:18.229908 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-bf5d9233-e999-4db5-ab87-30e549425a20 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:18.230682 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-bf5d9233-e999-4db5-ab87-30e549425a20 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:18.231105 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-bf5d9233-e999-4db5-ab87-30e549425a20 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:18.364206 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-bf5d9233-e999-4db5-ab87-30e549425a20 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:18.371926 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-bf5d9233-e999-4db5-ab87-30e549425a20 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e" status: 200 len: 1516 microversion: 2.1 time: 0.154665 Jun 16 19:00:18.372485 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 68/135] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:18 2022] GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:18.389498 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-0c4fc374-bc4c-40fd-81b2-076759106867 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:00:18.390554 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-0c4fc374-bc4c-40fd-81b2-076759106867 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1e6f9976-8df1-4719-a873-ab83b056f95e] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:18.397018 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-0c4fc374-bc4c-40fd-81b2-076759106867 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:18.397177 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-db3e2906-2e78-432d-90c5-a50332f10f79 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:18.397501 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-0c4fc374-bc4c-40fd-81b2-076759106867 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:18.397780 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-db3e2906-2e78-432d-90c5-a50332f10f79 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:18.398270 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-0c4fc374-bc4c-40fd-81b2-076759106867 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:18.398736 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-0c4fc374-bc4c-40fd-81b2-076759106867 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:18.404044 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-db3e2906-2e78-432d-90c5-a50332f10f79 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:18.404486 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-db3e2906-2e78-432d-90c5-a50332f10f79 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:18.405914 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-db3e2906-2e78-432d-90c5-a50332f10f79 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:18.406705 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-db3e2906-2e78-432d-90c5-a50332f10f79 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:18.465011 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.objects.instance [None req-0c4fc374-bc4c-40fd-81b2-076759106867 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lazy-loading 'flavor' on Instance uuid 1e6f9976-8df1-4719-a873-ab83b056f95e {{(pid=117852) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:00:18.548067 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-db3e2906-2e78-432d-90c5-a50332f10f79 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:18.555944 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-db3e2906-2e78-432d-90c5-a50332f10f79 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1362 microversion: 2.1 time: 0.162526 Jun 16 19:00:18.556508 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 69/136] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:18 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:18.598054 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-0c4fc374-bc4c-40fd-81b2-076759106867 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "POST /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e/action" status: 200 len: 32 microversion: 2.1 time: 0.212618 Jun 16 19:00:18.598681 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 68/137] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Jun 16 19:00:18 2022] POST /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e/action => generated 32 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 19:00:18.610481 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-519301e7-c5bc-4280-99ab-5d90db63fab1 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:18.610967 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-519301e7-c5bc-4280-99ab-5d90db63fab1 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1e6f9976-8df1-4719-a873-ab83b056f95e] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:18.617240 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-519301e7-c5bc-4280-99ab-5d90db63fab1 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:18.617894 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-519301e7-c5bc-4280-99ab-5d90db63fab1 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:18.618755 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-519301e7-c5bc-4280-99ab-5d90db63fab1 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:18.619428 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-519301e7-c5bc-4280-99ab-5d90db63fab1 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:18.806839 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-519301e7-c5bc-4280-99ab-5d90db63fab1 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:18.818292 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-519301e7-c5bc-4280-99ab-5d90db63fab1 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e" status: 200 len: 1522 microversion: 2.1 time: 0.213447 Jun 16 19:00:18.818890 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 70/138] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:18 2022] GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:19.156353 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-dc196fce-75f5-43ad-b973-c8b196ed6de8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:19.157235 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-dc196fce-75f5-43ad-b973-c8b196ed6de8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:19.175021 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-dc196fce-75f5-43ad-b973-c8b196ed6de8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:19.178066 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-dc196fce-75f5-43ad-b973-c8b196ed6de8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:19.179565 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-dc196fce-75f5-43ad-b973-c8b196ed6de8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:19.180259 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-dc196fce-75f5-43ad-b973-c8b196ed6de8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:19.226223 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-40768b12-0336-46bc-b3f6-ebe8624d702a tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fb818ded-a001-4d8d-a2a7-d4cffc2682ca"}} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:00:19.227596 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-40768b12-0336-46bc-b3f6-ebe8624d702a tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] [instance: de7eb4c7-a555-44f0-84c2-428b23b31a2d] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:19.234318 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-40768b12-0336-46bc-b3f6-ebe8624d702a tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:19.234809 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-40768b12-0336-46bc-b3f6-ebe8624d702a tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:19.235620 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-40768b12-0336-46bc-b3f6-ebe8624d702a tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:19.236059 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-40768b12-0336-46bc-b3f6-ebe8624d702a tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:19.337993 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-dc196fce-75f5-43ad-b973-c8b196ed6de8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:19.347881 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-dc196fce-75f5-43ad-b973-c8b196ed6de8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:19.349930 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-dc196fce-75f5-43ad-b973-c8b196ed6de8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:19.351205 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-dc196fce-75f5-43ad-b973-c8b196ed6de8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1406 microversion: 2.20 time: 0.216601 Jun 16 19:00:19.354956 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 69/139] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:00:19 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1406 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:00:19.576929 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-d1f28c4b-5ac4-4b68-b2b2-6a4027ea6058 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:19.578761 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-d1f28c4b-5ac4-4b68-b2b2-6a4027ea6058 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:19.588817 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d1f28c4b-5ac4-4b68-b2b2-6a4027ea6058 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:19.589290 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d1f28c4b-5ac4-4b68-b2b2-6a4027ea6058 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:19.590918 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d1f28c4b-5ac4-4b68-b2b2-6a4027ea6058 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:19.591360 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d1f28c4b-5ac4-4b68-b2b2-6a4027ea6058 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:19.794218 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-d1f28c4b-5ac4-4b68-b2b2-6a4027ea6058 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:19.804470 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-d1f28c4b-5ac4-4b68-b2b2-6a4027ea6058 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1362 microversion: 2.1 time: 0.233686 Jun 16 19:00:19.805503 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 70/140] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:19 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1362 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:19.819629 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-40768b12-0336-46bc-b3f6-ebe8624d702a tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] 10.222.0.70 "POST /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.597978 Jun 16 19:00:19.820274 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 71/141] 10.222.0.70 () {60 vars in 1322 bytes} [Thu Jun 16 19:00:19 2022] POST /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d/os-volume_attachments => generated 194 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:00:19.837758 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-06c839c0-7dae-4071-9359-838805ab1dd6 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:19.838398 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-06c839c0-7dae-4071-9359-838805ab1dd6 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1e6f9976-8df1-4719-a873-ab83b056f95e] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:19.867134 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-06c839c0-7dae-4071-9359-838805ab1dd6 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:19.867918 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-06c839c0-7dae-4071-9359-838805ab1dd6 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:19.868732 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-06c839c0-7dae-4071-9359-838805ab1dd6 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:19.869243 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-06c839c0-7dae-4071-9359-838805ab1dd6 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:20.043224 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-06c839c0-7dae-4071-9359-838805ab1dd6 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:20.051002 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-06c839c0-7dae-4071-9359-838805ab1dd6 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e" status: 200 len: 1522 microversion: 2.1 time: 0.219309 Jun 16 19:00:20.051823 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 71/142] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:19 2022] GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:20.370260 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-a5ccf168-8309-4ffe-ba2c-5d4174fa07e3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:20.371530 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-a5ccf168-8309-4ffe-ba2c-5d4174fa07e3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:20.380223 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-a5ccf168-8309-4ffe-ba2c-5d4174fa07e3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:20.380727 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-a5ccf168-8309-4ffe-ba2c-5d4174fa07e3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:20.381545 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-a5ccf168-8309-4ffe-ba2c-5d4174fa07e3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:20.381983 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-a5ccf168-8309-4ffe-ba2c-5d4174fa07e3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:20.543408 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-a5ccf168-8309-4ffe-ba2c-5d4174fa07e3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:20.559420 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-a5ccf168-8309-4ffe-ba2c-5d4174fa07e3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:20.562117 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-a5ccf168-8309-4ffe-ba2c-5d4174fa07e3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:20.563902 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-a5ccf168-8309-4ffe-ba2c-5d4174fa07e3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1406 microversion: 2.20 time: 0.198270 Jun 16 19:00:20.565136 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 72/143] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:00:20 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1406 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:00:20.823497 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-33c1f9c6-a736-457e-a808-e471f794b0fd tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:20.824290 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-33c1f9c6-a736-457e-a808-e471f794b0fd tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:20.832145 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-33c1f9c6-a736-457e-a808-e471f794b0fd tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:20.833330 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-33c1f9c6-a736-457e-a808-e471f794b0fd tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:20.834763 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-33c1f9c6-a736-457e-a808-e471f794b0fd tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:20.835522 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-33c1f9c6-a736-457e-a808-e471f794b0fd tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:21.022128 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-33c1f9c6-a736-457e-a808-e471f794b0fd tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:21.038076 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-33c1f9c6-a736-457e-a808-e471f794b0fd tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1362 microversion: 2.1 time: 0.218276 Jun 16 19:00:21.041086 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 72/144] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:20 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1362 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:21.069414 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-4f5ebaa3-64e9-4598-9902-15262063dacd tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:21.070177 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-4f5ebaa3-64e9-4598-9902-15262063dacd tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1e6f9976-8df1-4719-a873-ab83b056f95e] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:21.080328 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-4f5ebaa3-64e9-4598-9902-15262063dacd tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:21.080782 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-4f5ebaa3-64e9-4598-9902-15262063dacd tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:21.081641 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-4f5ebaa3-64e9-4598-9902-15262063dacd tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:21.082079 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-4f5ebaa3-64e9-4598-9902-15262063dacd tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:21.307692 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-4f5ebaa3-64e9-4598-9902-15262063dacd tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:21.317506 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-4f5ebaa3-64e9-4598-9902-15262063dacd tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e" status: 200 len: 1522 microversion: 2.1 time: 0.253155 Jun 16 19:00:21.318105 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 73/145] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:21 2022] GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e => generated 1522 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:21.585997 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-d278f558-cf11-4d39-8957-1059effc10a0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:21.586664 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-d278f558-cf11-4d39-8957-1059effc10a0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:21.589239 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_api:SELECT=96 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:00:21.595710 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d278f558-cf11-4d39-8957-1059effc10a0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:21.596158 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d278f558-cf11-4d39-8957-1059effc10a0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:21.596923 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d278f558-cf11-4d39-8957-1059effc10a0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:21.597355 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d278f558-cf11-4d39-8957-1059effc10a0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:21.759852 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-d278f558-cf11-4d39-8957-1059effc10a0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:21.770214 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-d278f558-cf11-4d39-8957-1059effc10a0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:21.771775 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-d278f558-cf11-4d39-8957-1059effc10a0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:21.772893 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-d278f558-cf11-4d39-8957-1059effc10a0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1406 microversion: 2.20 time: 0.192374 Jun 16 19:00:21.773677 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 73/146] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:00:21 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1406 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:00:22.060484 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-45652f2b-963f-488e-bb59-663b79bd77c3 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:22.061114 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-45652f2b-963f-488e-bb59-663b79bd77c3 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:22.070088 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-45652f2b-963f-488e-bb59-663b79bd77c3 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:22.070781 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-45652f2b-963f-488e-bb59-663b79bd77c3 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:22.071615 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-45652f2b-963f-488e-bb59-663b79bd77c3 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:22.072114 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-45652f2b-963f-488e-bb59-663b79bd77c3 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:22.216423 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-45652f2b-963f-488e-bb59-663b79bd77c3 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:22.230828 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-45652f2b-963f-488e-bb59-663b79bd77c3 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1362 microversion: 2.1 time: 0.174698 Jun 16 19:00:22.245475 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 74/147] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:22 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1362 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:22.337108 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-6fc57f72-f924-46f6-bf27-6f09b35c5f40 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:22.337781 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-6fc57f72-f924-46f6-bf27-6f09b35c5f40 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1e6f9976-8df1-4719-a873-ab83b056f95e] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:22.344363 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-6fc57f72-f924-46f6-bf27-6f09b35c5f40 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:22.345158 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-6fc57f72-f924-46f6-bf27-6f09b35c5f40 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:22.346336 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-6fc57f72-f924-46f6-bf27-6f09b35c5f40 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:22.346961 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-6fc57f72-f924-46f6-bf27-6f09b35c5f40 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:22.351509 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:00:22.515012 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-6fc57f72-f924-46f6-bf27-6f09b35c5f40 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:22.523185 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-6fc57f72-f924-46f6-bf27-6f09b35c5f40 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e" status: 200 len: 1522 microversion: 2.1 time: 0.191291 Jun 16 19:00:22.524282 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 74/148] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:22 2022] GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:22.794052 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-84f9a7be-2da0-4f4f-8c87-ee360a578649 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:22.794884 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-84f9a7be-2da0-4f4f-8c87-ee360a578649 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:22.806951 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-84f9a7be-2da0-4f4f-8c87-ee360a578649 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:22.807405 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-84f9a7be-2da0-4f4f-8c87-ee360a578649 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:22.808187 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-84f9a7be-2da0-4f4f-8c87-ee360a578649 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:22.808613 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-84f9a7be-2da0-4f4f-8c87-ee360a578649 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:22.954470 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-84f9a7be-2da0-4f4f-8c87-ee360a578649 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:22.963909 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-84f9a7be-2da0-4f4f-8c87-ee360a578649 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:22.965410 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-84f9a7be-2da0-4f4f-8c87-ee360a578649 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:22.966607 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-84f9a7be-2da0-4f4f-8c87-ee360a578649 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1406 microversion: 2.20 time: 0.176560 Jun 16 19:00:22.967358 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 75/149] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:00:22 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1406 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:00:23.251063 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-4ef94376-110a-49aa-a22a-01e8872bb054 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:23.251063 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-4ef94376-110a-49aa-a22a-01e8872bb054 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:23.256740 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-4ef94376-110a-49aa-a22a-01e8872bb054 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:23.257190 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-4ef94376-110a-49aa-a22a-01e8872bb054 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:23.257958 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-4ef94376-110a-49aa-a22a-01e8872bb054 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:23.258424 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-4ef94376-110a-49aa-a22a-01e8872bb054 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:23.425207 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-4ef94376-110a-49aa-a22a-01e8872bb054 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:23.432887 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-4ef94376-110a-49aa-a22a-01e8872bb054 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1362 microversion: 2.1 time: 0.187140 Jun 16 19:00:23.433444 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 75/150] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:23 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:23.540715 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-633fdf0f-8345-40fd-b3fc-195e6901facc tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:23.541423 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-633fdf0f-8345-40fd-b3fc-195e6901facc tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1e6f9976-8df1-4719-a873-ab83b056f95e] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:23.548539 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-633fdf0f-8345-40fd-b3fc-195e6901facc tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:23.548982 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-633fdf0f-8345-40fd-b3fc-195e6901facc tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:23.549855 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-633fdf0f-8345-40fd-b3fc-195e6901facc tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:23.550208 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-633fdf0f-8345-40fd-b3fc-195e6901facc tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:23.705208 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-633fdf0f-8345-40fd-b3fc-195e6901facc tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:23.713271 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-633fdf0f-8345-40fd-b3fc-195e6901facc tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e" status: 200 len: 1522 microversion: 2.1 time: 0.176414 Jun 16 19:00:23.713843 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 76/151] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:23 2022] GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:23.985985 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-3dcefec3-ead7-4af0-86a8-ee95661e77f0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:23.986856 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-3dcefec3-ead7-4af0-86a8-ee95661e77f0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:23.993639 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-3dcefec3-ead7-4af0-86a8-ee95661e77f0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:23.994087 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-3dcefec3-ead7-4af0-86a8-ee95661e77f0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:23.994906 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-3dcefec3-ead7-4af0-86a8-ee95661e77f0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:23.995374 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-3dcefec3-ead7-4af0-86a8-ee95661e77f0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:24.139944 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-3dcefec3-ead7-4af0-86a8-ee95661e77f0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:24.150332 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-3dcefec3-ead7-4af0-86a8-ee95661e77f0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:24.152405 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-3dcefec3-ead7-4af0-86a8-ee95661e77f0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:24.153862 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-3dcefec3-ead7-4af0-86a8-ee95661e77f0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1406 microversion: 2.20 time: 0.172390 Jun 16 19:00:24.164151 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 76/152] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:00:23 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1406 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:00:24.462873 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-fe2b262a-0084-4e07-9737-4add26255378 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:24.463555 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-fe2b262a-0084-4e07-9737-4add26255378 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:24.475480 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_api:SELECT=96 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:00:24.477544 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-fe2b262a-0084-4e07-9737-4add26255378 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:24.477980 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-fe2b262a-0084-4e07-9737-4add26255378 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:24.482918 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-fe2b262a-0084-4e07-9737-4add26255378 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:24.484005 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-fe2b262a-0084-4e07-9737-4add26255378 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:24.683801 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-fe2b262a-0084-4e07-9737-4add26255378 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:24.692060 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-fe2b262a-0084-4e07-9737-4add26255378 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1362 microversion: 2.1 time: 0.244391 Jun 16 19:00:24.692627 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 77/153] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:24 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1362 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:24.732200 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-d8bf1060-f0bb-4887-a62c-c84cdba995b3 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:24.732957 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-d8bf1060-f0bb-4887-a62c-c84cdba995b3 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1e6f9976-8df1-4719-a873-ab83b056f95e] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:24.744194 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d8bf1060-f0bb-4887-a62c-c84cdba995b3 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:24.745610 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d8bf1060-f0bb-4887-a62c-c84cdba995b3 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:24.746730 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d8bf1060-f0bb-4887-a62c-c84cdba995b3 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:24.747668 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d8bf1060-f0bb-4887-a62c-c84cdba995b3 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:25.084743 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-d8bf1060-f0bb-4887-a62c-c84cdba995b3 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:25.096932 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-d8bf1060-f0bb-4887-a62c-c84cdba995b3 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e" status: 200 len: 1522 microversion: 2.1 time: 0.368578 Jun 16 19:00:25.098396 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 77/154] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:24 2022] GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e => generated 1522 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:25.174416 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-ec5e134e-6e2f-405e-b766-b780321cacf3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:25.175066 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-ec5e134e-6e2f-405e-b766-b780321cacf3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:25.183978 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-ec5e134e-6e2f-405e-b766-b780321cacf3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:25.184336 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-ec5e134e-6e2f-405e-b766-b780321cacf3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:25.185420 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-ec5e134e-6e2f-405e-b766-b780321cacf3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:25.185853 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-ec5e134e-6e2f-405e-b766-b780321cacf3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:25.350954 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-ec5e134e-6e2f-405e-b766-b780321cacf3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:25.360783 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-ec5e134e-6e2f-405e-b766-b780321cacf3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:25.362309 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-ec5e134e-6e2f-405e-b766-b780321cacf3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:25.363519 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-ec5e134e-6e2f-405e-b766-b780321cacf3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1598 microversion: 2.20 time: 0.194271 Jun 16 19:00:25.364445 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 78/155] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:00:25 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1598 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:00:25.383913 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-bd3ed986-d927-4d2e-9890-d480f1a01769 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:25.384144 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-bd3ed986-d927-4d2e-9890-d480f1a01769 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:25.396796 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-bd3ed986-d927-4d2e-9890-d480f1a01769 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:25.398002 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-bd3ed986-d927-4d2e-9890-d480f1a01769 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:25.399774 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-bd3ed986-d927-4d2e-9890-d480f1a01769 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:25.400535 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-bd3ed986-d927-4d2e-9890-d480f1a01769 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:25.710509 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-809163ea-448c-4815-8c5b-97f50dd1fcd9 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:25.711148 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-809163ea-448c-4815-8c5b-97f50dd1fcd9 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:25.722120 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-809163ea-448c-4815-8c5b-97f50dd1fcd9 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:25.722566 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-809163ea-448c-4815-8c5b-97f50dd1fcd9 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:25.723444 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-809163ea-448c-4815-8c5b-97f50dd1fcd9 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:25.723910 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-809163ea-448c-4815-8c5b-97f50dd1fcd9 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:25.763783 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-bd3ed986-d927-4d2e-9890-d480f1a01769 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.385412 Jun 16 19:00:25.771683 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 78/156] 10.222.0.70 () {60 vars in 1315 bytes} [Thu Jun 16 19:00:25 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4/os-interface => generated 284 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 19:00:25.895820 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-809163ea-448c-4815-8c5b-97f50dd1fcd9 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:25.904277 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-809163ea-448c-4815-8c5b-97f50dd1fcd9 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1548 microversion: 2.1 time: 0.198286 Jun 16 19:00:25.904853 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 79/157] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:25 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1548 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:00:25.922095 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-cdf4d311-f6e4-4abd-a973-275a8f52266a tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:25.922619 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-cdf4d311-f6e4-4abd-a973-275a8f52266a tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:25.929251 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-cdf4d311-f6e4-4abd-a973-275a8f52266a tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:25.929707 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-cdf4d311-f6e4-4abd-a973-275a8f52266a tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:25.930477 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-cdf4d311-f6e4-4abd-a973-275a8f52266a tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:25.930958 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-cdf4d311-f6e4-4abd-a973-275a8f52266a tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:26.118386 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-094a5e5a-ac80-4656-94b1-f6f05a34255f tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:26.119184 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-094a5e5a-ac80-4656-94b1-f6f05a34255f tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1e6f9976-8df1-4719-a873-ab83b056f95e] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:26.127155 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-094a5e5a-ac80-4656-94b1-f6f05a34255f tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:26.127872 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-094a5e5a-ac80-4656-94b1-f6f05a34255f tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:26.128747 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-094a5e5a-ac80-4656-94b1-f6f05a34255f tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:26.129275 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-094a5e5a-ac80-4656-94b1-f6f05a34255f tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:26.133566 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-cdf4d311-f6e4-4abd-a973-275a8f52266a tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.215848 Jun 16 19:00:26.134264 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 79/158] 10.222.0.70 () {58 vars in 1274 bytes} [Thu Jun 16 19:00:25 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee/os-interface => generated 285 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:00:26.463229 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-094a5e5a-ac80-4656-94b1-f6f05a34255f tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:26.467875 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:00:26.482394 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-094a5e5a-ac80-4656-94b1-f6f05a34255f tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e" status: 200 len: 1522 microversion: 2.1 time: 0.370221 Jun 16 19:00:26.486758 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 80/159] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:26 2022] GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e => generated 1522 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:27.504611 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-54077efa-d8ba-475e-8650-9c30faa3bca8 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:27.506606 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-54077efa-d8ba-475e-8650-9c30faa3bca8 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1e6f9976-8df1-4719-a873-ab83b056f95e] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:27.515159 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-54077efa-d8ba-475e-8650-9c30faa3bca8 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:27.515840 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-54077efa-d8ba-475e-8650-9c30faa3bca8 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:27.517403 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-54077efa-d8ba-475e-8650-9c30faa3bca8 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:27.518006 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-54077efa-d8ba-475e-8650-9c30faa3bca8 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:27.872433 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [req-2166d34e-508c-4af2-a896-2627e2ba5726 req-67f4c82f-8feb-419c-a71b-3c7453a5998e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fb4cc0a-23a8-417c-a8a1-35501c2690ee", "tag": "523e7a48-bea7-4e32-9e88-5f62ea569a81"}]} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:00:27.898055 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-2166d34e-508c-4af2-a896-2627e2ba5726 req-67f4c82f-8feb-419c-a71b-3c7453a5998e service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:27.898812 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-2166d34e-508c-4af2-a896-2627e2ba5726 req-67f4c82f-8feb-419c-a71b-3c7453a5998e service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:27.900212 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-54077efa-d8ba-475e-8650-9c30faa3bca8 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:27.908048 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-54077efa-d8ba-475e-8650-9c30faa3bca8 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e" status: 200 len: 1522 microversion: 2.1 time: 0.407423 Jun 16 19:00:27.908628 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 80/160] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:27 2022] GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e => generated 1522 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:27.912937 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.compute.server_external_events [req-2166d34e-508c-4af2-a896-2627e2ba5726 req-67f4c82f-8feb-419c-a71b-3c7453a5998e service nova] Creating event network-changed:523e7a48-bea7-4e32-9e88-5f62ea569a81 for instance 2fb4cc0a-23a8-417c-a8a1-35501c2690ee on hv-cinder-84617 Jun 16 19:00:27.919523 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [req-2166d34e-508c-4af2-a896-2627e2ba5726 req-67f4c82f-8feb-419c-a71b-3c7453a5998e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050978 Jun 16 19:00:27.921175 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 81/161] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:00:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:00:28.197557 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [req-00203685-7379-4a36-bed7-97d699e5c2d6 req-965b8a74-20cd-4a9b-a865-8c48cfeed13d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c077a29-12e0-48af-a8b6-43d0b5a79bf4", "tag": "3e9e841e-467e-4321-a3d7-1999929bc359"}]} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:00:28.206793 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-00203685-7379-4a36-bed7-97d699e5c2d6 req-965b8a74-20cd-4a9b-a865-8c48cfeed13d service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:28.207546 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-00203685-7379-4a36-bed7-97d699e5c2d6 req-965b8a74-20cd-4a9b-a865-8c48cfeed13d service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:28.220902 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.compute.server_external_events [req-00203685-7379-4a36-bed7-97d699e5c2d6 req-965b8a74-20cd-4a9b-a865-8c48cfeed13d service nova] Creating event network-changed:3e9e841e-467e-4321-a3d7-1999929bc359 for instance 1c077a29-12e0-48af-a8b6-43d0b5a79bf4 on hv-cinder-84617 Jun 16 19:00:28.226445 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [req-00203685-7379-4a36-bed7-97d699e5c2d6 req-965b8a74-20cd-4a9b-a865-8c48cfeed13d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032457 Jun 16 19:00:28.227458 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 81/162] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:00:28.925721 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-3db4edb7-7ca7-4bf7-b2df-7165f9e7dfb7 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:28.926931 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-3db4edb7-7ca7-4bf7-b2df-7165f9e7dfb7 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1e6f9976-8df1-4719-a873-ab83b056f95e] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:28.949276 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-3db4edb7-7ca7-4bf7-b2df-7165f9e7dfb7 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:28.950799 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-3db4edb7-7ca7-4bf7-b2df-7165f9e7dfb7 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:28.951696 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-3db4edb7-7ca7-4bf7-b2df-7165f9e7dfb7 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:28.952127 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-3db4edb7-7ca7-4bf7-b2df-7165f9e7dfb7 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:29.207759 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-3db4edb7-7ca7-4bf7-b2df-7165f9e7dfb7 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:29.220331 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-3db4edb7-7ca7-4bf7-b2df-7165f9e7dfb7 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e" status: 200 len: 1522 microversion: 2.1 time: 0.299067 Jun 16 19:00:29.221651 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 82/163] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:28 2022] GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e => generated 1522 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:30.240121 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-6bbbc61e-00f5-4e4b-a59f-c0c751aa3fdf tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:30.241532 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-6bbbc61e-00f5-4e4b-a59f-c0c751aa3fdf tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1e6f9976-8df1-4719-a873-ab83b056f95e] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:30.249119 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-6bbbc61e-00f5-4e4b-a59f-c0c751aa3fdf tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:30.249925 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-6bbbc61e-00f5-4e4b-a59f-c0c751aa3fdf tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:30.252642 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-6bbbc61e-00f5-4e4b-a59f-c0c751aa3fdf tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:30.256736 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-6bbbc61e-00f5-4e4b-a59f-c0c751aa3fdf tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:30.886357 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-6bbbc61e-00f5-4e4b-a59f-c0c751aa3fdf tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:30.896035 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-6bbbc61e-00f5-4e4b-a59f-c0c751aa3fdf tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e" status: 200 len: 1522 microversion: 2.1 time: 0.661925 Jun 16 19:00:30.907742 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 82/164] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:30 2022] GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e => generated 1522 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:31.915731 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-9ea1e22c-3fda-403b-8205-bc5e679eaab9 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:31.916508 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-9ea1e22c-3fda-403b-8205-bc5e679eaab9 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1e6f9976-8df1-4719-a873-ab83b056f95e] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:31.930561 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-9ea1e22c-3fda-403b-8205-bc5e679eaab9 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:31.932485 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-9ea1e22c-3fda-403b-8205-bc5e679eaab9 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:31.934508 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-9ea1e22c-3fda-403b-8205-bc5e679eaab9 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:31.935045 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-9ea1e22c-3fda-403b-8205-bc5e679eaab9 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:32.103491 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-9ea1e22c-3fda-403b-8205-bc5e679eaab9 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:32.113710 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-9ea1e22c-3fda-403b-8205-bc5e679eaab9 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e" status: 200 len: 1522 microversion: 2.1 time: 0.202047 Jun 16 19:00:32.114668 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 83/165] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:31 2022] GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:33.131176 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-011069ef-6b33-4544-b103-9074dcb40be5 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:33.131774 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-011069ef-6b33-4544-b103-9074dcb40be5 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1e6f9976-8df1-4719-a873-ab83b056f95e] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:33.148937 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-011069ef-6b33-4544-b103-9074dcb40be5 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:33.149389 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-011069ef-6b33-4544-b103-9074dcb40be5 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:33.150168 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-011069ef-6b33-4544-b103-9074dcb40be5 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:33.155350 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-011069ef-6b33-4544-b103-9074dcb40be5 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:33.413151 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-011069ef-6b33-4544-b103-9074dcb40be5 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:33.422243 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-011069ef-6b33-4544-b103-9074dcb40be5 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e" status: 200 len: 1522 microversion: 2.1 time: 0.294693 Jun 16 19:00:33.442756 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 83/166] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:33 2022] GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e => generated 1522 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:34.443188 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-bff165b4-9ba6-4758-91f1-cbfe68bc98a2 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:34.443857 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-bff165b4-9ba6-4758-91f1-cbfe68bc98a2 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1e6f9976-8df1-4719-a873-ab83b056f95e] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:34.469237 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-bff165b4-9ba6-4758-91f1-cbfe68bc98a2 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:34.469883 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-bff165b4-9ba6-4758-91f1-cbfe68bc98a2 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:34.470926 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-bff165b4-9ba6-4758-91f1-cbfe68bc98a2 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:34.471517 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-bff165b4-9ba6-4758-91f1-cbfe68bc98a2 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:34.723790 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-bff165b4-9ba6-4758-91f1-cbfe68bc98a2 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:34.731371 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-bff165b4-9ba6-4758-91f1-cbfe68bc98a2 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e" status: 200 len: 1522 microversion: 2.1 time: 0.296875 Jun 16 19:00:34.742204 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 84/167] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:34 2022] GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e => generated 1522 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:35.732400 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-b7a2d3fe-1eac-49ab-a868-0dc29c2b0dcd tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Action: 'create', calling method: .version_select at 0x7f12e623a5e0>, body: {"keypair": {"name": "tempest-TestShelveInstance-316787948", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDOBJDbft6KH2YPNH/kfK0RkiUtusJMdXM2UYgOPgI7s3KOSmtNbDGytXyoPe74soSBXGvjVhB9pHJgutgH4YQRdV19D1UVJeaP1ZEenj5db40hzKbykAeTEpLtzX4U6vQ=="}} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:00:35.747655 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.quota [None req-b7a2d3fe-1eac-49ab-a868-0dc29c2b0dcd tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Getting quotas for project 629634dc3dc54893b68cb9c9dc08505d. Resources: {'key_pairs'} {{(pid=117852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:00:35.750257 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-8b630df2-b5e7-4b82-9082-d93f653a5d24 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:35.751074 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-8b630df2-b5e7-4b82-9082-d93f653a5d24 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1e6f9976-8df1-4719-a873-ab83b056f95e] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:35.752832 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.quota [None req-b7a2d3fe-1eac-49ab-a868-0dc29c2b0dcd tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Getting quotas for user 27db09b804fa426a83f103cf5dd116a8 and project 629634dc3dc54893b68cb9c9dc08505d. Resources: {'key_pairs'} {{(pid=117852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:00:35.757987 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-8b630df2-b5e7-4b82-9082-d93f653a5d24 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:35.758442 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-8b630df2-b5e7-4b82-9082-d93f653a5d24 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:35.759388 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-8b630df2-b5e7-4b82-9082-d93f653a5d24 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:35.759834 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-8b630df2-b5e7-4b82-9082-d93f653a5d24 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:35.782444 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-b7a2d3fe-1eac-49ab-a868-0dc29c2b0dcd tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.229734 Jun 16 19:00:35.783170 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 84/168] 10.222.0.70 () {60 vars in 1158 bytes} [Thu Jun 16 19:00:35 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:00:36.145181 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-8b630df2-b5e7-4b82-9082-d93f653a5d24 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:36.155357 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-8b630df2-b5e7-4b82-9082-d93f653a5d24 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e" status: 200 len: 1522 microversion: 2.1 time: 0.409840 Jun 16 19:00:36.156850 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 85/169] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:35 2022] GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e => generated 1522 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:00:37.175221 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-d84b661a-f335-459e-a949-855fc335694e tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:37.176052 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-d84b661a-f335-459e-a949-855fc335694e tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1e6f9976-8df1-4719-a873-ab83b056f95e] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:37.189912 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d84b661a-f335-459e-a949-855fc335694e tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:37.190694 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d84b661a-f335-459e-a949-855fc335694e tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:37.191767 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d84b661a-f335-459e-a949-855fc335694e tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:37.192501 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d84b661a-f335-459e-a949-855fc335694e tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:37.444060 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-d84b661a-f335-459e-a949-855fc335694e tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:37.452208 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-d84b661a-f335-459e-a949-855fc335694e tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e" status: 200 len: 1522 microversion: 2.1 time: 0.281914 Jun 16 19:00:37.452930 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 85/170] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:37 2022] GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e => generated 1522 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:38.472160 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-eed081d8-190b-4b6e-bbd1-865eb70031ee tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:38.472926 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-eed081d8-190b-4b6e-bbd1-865eb70031ee tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1e6f9976-8df1-4719-a873-ab83b056f95e] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:38.482470 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-eed081d8-190b-4b6e-bbd1-865eb70031ee tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:38.483216 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-eed081d8-190b-4b6e-bbd1-865eb70031ee tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:38.484658 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-eed081d8-190b-4b6e-bbd1-865eb70031ee tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:38.485289 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-eed081d8-190b-4b6e-bbd1-865eb70031ee tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:38.699321 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-eed081d8-190b-4b6e-bbd1-865eb70031ee tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:38.715550 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-eed081d8-190b-4b6e-bbd1-865eb70031ee tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e" status: 200 len: 1522 microversion: 2.1 time: 0.249242 Jun 16 19:00:38.716611 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 86/171] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:38 2022] GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:39.734460 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-e03a97e0-f1d4-42f5-ac10-0567f0275c70 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:39.735351 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-e03a97e0-f1d4-42f5-ac10-0567f0275c70 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1e6f9976-8df1-4719-a873-ab83b056f95e] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:39.746992 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-e03a97e0-f1d4-42f5-ac10-0567f0275c70 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:39.747441 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-e03a97e0-f1d4-42f5-ac10-0567f0275c70 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:39.748341 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-e03a97e0-f1d4-42f5-ac10-0567f0275c70 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:39.752662 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-e03a97e0-f1d4-42f5-ac10-0567f0275c70 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:39.905936 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-e03a97e0-f1d4-42f5-ac10-0567f0275c70 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:39.914834 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-e03a97e0-f1d4-42f5-ac10-0567f0275c70 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e" status: 200 len: 1522 microversion: 2.1 time: 0.185359 Jun 16 19:00:39.915395 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 86/172] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:39 2022] GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:40.933415 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-a027265c-c0e2-49d3-ae66-5ead63cddb72 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:40.933993 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-a027265c-c0e2-49d3-ae66-5ead63cddb72 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1e6f9976-8df1-4719-a873-ab83b056f95e] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:40.942618 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-a027265c-c0e2-49d3-ae66-5ead63cddb72 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:40.942618 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-a027265c-c0e2-49d3-ae66-5ead63cddb72 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:40.942953 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-a027265c-c0e2-49d3-ae66-5ead63cddb72 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:40.943608 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-a027265c-c0e2-49d3-ae66-5ead63cddb72 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:41.082909 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-a027265c-c0e2-49d3-ae66-5ead63cddb72 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:41.092561 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-a027265c-c0e2-49d3-ae66-5ead63cddb72 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e" status: 200 len: 1522 microversion: 2.1 time: 0.162369 Jun 16 19:00:41.094621 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 87/173] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:40 2022] GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:42.109889 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-d8f26553-a27e-4298-acd6-39c1db9fecb0 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:42.110505 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-d8f26553-a27e-4298-acd6-39c1db9fecb0 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1e6f9976-8df1-4719-a873-ab83b056f95e] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:42.116694 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d8f26553-a27e-4298-acd6-39c1db9fecb0 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:42.117138 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d8f26553-a27e-4298-acd6-39c1db9fecb0 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:42.117896 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d8f26553-a27e-4298-acd6-39c1db9fecb0 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:42.118324 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d8f26553-a27e-4298-acd6-39c1db9fecb0 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:42.264976 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-d8f26553-a27e-4298-acd6-39c1db9fecb0 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:42.272665 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-d8f26553-a27e-4298-acd6-39c1db9fecb0 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e" status: 200 len: 1522 microversion: 2.1 time: 0.167750 Jun 16 19:00:42.273229 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 87/174] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:42 2022] GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:43.290860 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-202e8dc8-ae29-4401-970e-ec2df0b65e4d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:43.291478 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-202e8dc8-ae29-4401-970e-ec2df0b65e4d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1e6f9976-8df1-4719-a873-ab83b056f95e] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:43.298671 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-202e8dc8-ae29-4401-970e-ec2df0b65e4d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:43.299142 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-202e8dc8-ae29-4401-970e-ec2df0b65e4d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:43.299888 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-202e8dc8-ae29-4401-970e-ec2df0b65e4d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:43.300328 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-202e8dc8-ae29-4401-970e-ec2df0b65e4d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:43.437937 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-202e8dc8-ae29-4401-970e-ec2df0b65e4d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:43.446419 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-202e8dc8-ae29-4401-970e-ec2df0b65e4d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e" status: 200 len: 1522 microversion: 2.1 time: 0.159362 Jun 16 19:00:43.457308 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 88/175] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:43 2022] GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:44.468227 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-ab03869b-3a32-4dfa-a34e-e2bf676de3d7 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:44.469489 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-ab03869b-3a32-4dfa-a34e-e2bf676de3d7 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1e6f9976-8df1-4719-a873-ab83b056f95e] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:44.503254 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ab03869b-3a32-4dfa-a34e-e2bf676de3d7 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:44.503254 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ab03869b-3a32-4dfa-a34e-e2bf676de3d7 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:44.503254 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ab03869b-3a32-4dfa-a34e-e2bf676de3d7 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:44.503254 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ab03869b-3a32-4dfa-a34e-e2bf676de3d7 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:44.698268 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-ab03869b-3a32-4dfa-a34e-e2bf676de3d7 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:44.707223 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-ab03869b-3a32-4dfa-a34e-e2bf676de3d7 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e" status: 200 len: 1522 microversion: 2.1 time: 0.245082 Jun 16 19:00:44.707810 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 88/176] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:44 2022] GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:45.725102 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-86516b74-1989-4f7b-859a-e88d88b99339 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:45.726257 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-86516b74-1989-4f7b-859a-e88d88b99339 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1e6f9976-8df1-4719-a873-ab83b056f95e] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:45.735951 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-86516b74-1989-4f7b-859a-e88d88b99339 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:45.741981 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-86516b74-1989-4f7b-859a-e88d88b99339 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:45.744747 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-86516b74-1989-4f7b-859a-e88d88b99339 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:45.745193 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-86516b74-1989-4f7b-859a-e88d88b99339 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:45.959547 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-86516b74-1989-4f7b-859a-e88d88b99339 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:45.969691 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-86516b74-1989-4f7b-859a-e88d88b99339 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e" status: 200 len: 1522 microversion: 2.1 time: 0.249718 Jun 16 19:00:45.970283 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 89/177] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:45 2022] GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e => generated 1522 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:46.987427 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-032d4d7a-08e3-429f-b54e-3d5f6000fcc0 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:46.988044 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-032d4d7a-08e3-429f-b54e-3d5f6000fcc0 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1e6f9976-8df1-4719-a873-ab83b056f95e] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:46.991033 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_cell0:SELECT=4 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:00:46.995690 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-032d4d7a-08e3-429f-b54e-3d5f6000fcc0 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:46.996015 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-032d4d7a-08e3-429f-b54e-3d5f6000fcc0 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:46.996980 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-032d4d7a-08e3-429f-b54e-3d5f6000fcc0 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:46.997607 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-032d4d7a-08e3-429f-b54e-3d5f6000fcc0 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:47.143968 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-032d4d7a-08e3-429f-b54e-3d5f6000fcc0 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:47.151531 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-032d4d7a-08e3-429f-b54e-3d5f6000fcc0 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e" status: 200 len: 1522 microversion: 2.1 time: 0.168971 Jun 16 19:00:47.152096 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 89/178] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:46 2022] GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:48.168907 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-776a871a-d20a-4605-831e-62d18aac038a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:48.169503 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-776a871a-d20a-4605-831e-62d18aac038a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1e6f9976-8df1-4719-a873-ab83b056f95e] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:48.177296 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-776a871a-d20a-4605-831e-62d18aac038a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:48.177750 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-776a871a-d20a-4605-831e-62d18aac038a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:48.178521 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-776a871a-d20a-4605-831e-62d18aac038a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:48.178981 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-776a871a-d20a-4605-831e-62d18aac038a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:48.321579 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-776a871a-d20a-4605-831e-62d18aac038a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:48.329552 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-776a871a-d20a-4605-831e-62d18aac038a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e" status: 200 len: 1522 microversion: 2.1 time: 0.164356 Jun 16 19:00:48.330138 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 90/179] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:48 2022] GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:49.347733 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-2cc096ca-91d4-472e-953b-556ff72147a6 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:49.348367 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-2cc096ca-91d4-472e-953b-556ff72147a6 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1e6f9976-8df1-4719-a873-ab83b056f95e] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:49.354224 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-2cc096ca-91d4-472e-953b-556ff72147a6 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:49.354695 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-2cc096ca-91d4-472e-953b-556ff72147a6 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:49.355448 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-2cc096ca-91d4-472e-953b-556ff72147a6 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:49.355870 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-2cc096ca-91d4-472e-953b-556ff72147a6 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:49.516060 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-2cc096ca-91d4-472e-953b-556ff72147a6 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:49.524009 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-2cc096ca-91d4-472e-953b-556ff72147a6 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e" status: 200 len: 1522 microversion: 2.1 time: 0.180095 Jun 16 19:00:49.524582 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 90/180] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:49 2022] GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:00:50.049159 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-81cdcbd6-79ab-434f-9786-9fe30ab8ed8a tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:50.049717 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-81cdcbd6-79ab-434f-9786-9fe30ab8ed8a tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] [instance: de7eb4c7-a555-44f0-84c2-428b23b31a2d] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:50.059966 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-81cdcbd6-79ab-434f-9786-9fe30ab8ed8a tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:50.060775 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-81cdcbd6-79ab-434f-9786-9fe30ab8ed8a tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:50.062181 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-81cdcbd6-79ab-434f-9786-9fe30ab8ed8a tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:50.063166 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-81cdcbd6-79ab-434f-9786-9fe30ab8ed8a tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:50.096710 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-81cdcbd6-79ab-434f-9786-9fe30ab8ed8a tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] [instance: de7eb4c7-a555-44f0-84c2-428b23b31a2d] Going to try to terminate instance {{(pid=117850) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:00:50.192622 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-81cdcbd6-79ab-434f-9786-9fe30ab8ed8a tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] 10.222.0.70 "DELETE /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d" status: 204 len: 0 microversion: 2.1 time: 0.147964 Jun 16 19:00:50.193212 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 91/181] 10.222.0.70 () {58 vars in 1238 bytes} [Thu Jun 16 19:00:50 2022] DELETE /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:00:50.202446 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-788699a6-88dc-48bb-bf80-0520d269754d tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:50.203102 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-788699a6-88dc-48bb-bf80-0520d269754d tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] [instance: de7eb4c7-a555-44f0-84c2-428b23b31a2d] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:50.209506 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-788699a6-88dc-48bb-bf80-0520d269754d tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:50.209960 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-788699a6-88dc-48bb-bf80-0520d269754d tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:50.210750 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-788699a6-88dc-48bb-bf80-0520d269754d tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:50.211186 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-788699a6-88dc-48bb-bf80-0520d269754d tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:50.349993 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-788699a6-88dc-48bb-bf80-0520d269754d tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8813b3f6f8c46519fb827cf521bb37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de0652519d3447b8d0e4d948610071f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:50.358958 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-788699a6-88dc-48bb-bf80-0520d269754d tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] 10.222.0.70 "GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d" status: 200 len: 1554 microversion: 2.1 time: 0.161530 Jun 16 19:00:50.359720 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 91/182] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:50 2022] GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:50.541391 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-c97edeb4-42db-4a78-9b59-42cda18b0869 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:50.542152 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-c97edeb4-42db-4a78-9b59-42cda18b0869 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1e6f9976-8df1-4719-a873-ab83b056f95e] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:50.549622 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-c97edeb4-42db-4a78-9b59-42cda18b0869 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:50.551254 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-c97edeb4-42db-4a78-9b59-42cda18b0869 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:50.552299 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-c97edeb4-42db-4a78-9b59-42cda18b0869 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:50.552895 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-c97edeb4-42db-4a78-9b59-42cda18b0869 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:50.697918 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-c97edeb4-42db-4a78-9b59-42cda18b0869 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:50.706383 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-c97edeb4-42db-4a78-9b59-42cda18b0869 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e" status: 200 len: 1522 microversion: 2.1 time: 0.169529 Jun 16 19:00:50.707071 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 92/183] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:50 2022] GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:51.376766 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-a7406b02-7cb9-44b9-89ba-c52c4abc4d7c tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:51.377379 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-a7406b02-7cb9-44b9-89ba-c52c4abc4d7c tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] [instance: de7eb4c7-a555-44f0-84c2-428b23b31a2d] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:51.383652 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-a7406b02-7cb9-44b9-89ba-c52c4abc4d7c tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:51.384093 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-a7406b02-7cb9-44b9-89ba-c52c4abc4d7c tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:51.384839 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-a7406b02-7cb9-44b9-89ba-c52c4abc4d7c tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:51.385265 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-a7406b02-7cb9-44b9-89ba-c52c4abc4d7c tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:51.516504 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-a7406b02-7cb9-44b9-89ba-c52c4abc4d7c tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8813b3f6f8c46519fb827cf521bb37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de0652519d3447b8d0e4d948610071f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:51.524699 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-a7406b02-7cb9-44b9-89ba-c52c4abc4d7c tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] 10.222.0.70 "GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d" status: 200 len: 1554 microversion: 2.1 time: 0.152351 Jun 16 19:00:51.525258 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 92/184] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:51 2022] GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:51.724336 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-dbf4c9e9-bfac-424e-a79d-ed0d3e13b875 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:51.725025 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-dbf4c9e9-bfac-424e-a79d-ed0d3e13b875 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1e6f9976-8df1-4719-a873-ab83b056f95e] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:51.731858 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-dbf4c9e9-bfac-424e-a79d-ed0d3e13b875 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:51.732906 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-dbf4c9e9-bfac-424e-a79d-ed0d3e13b875 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:51.733743 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-dbf4c9e9-bfac-424e-a79d-ed0d3e13b875 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:51.734178 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-dbf4c9e9-bfac-424e-a79d-ed0d3e13b875 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:51.870555 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-dbf4c9e9-bfac-424e-a79d-ed0d3e13b875 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:51.879507 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-dbf4c9e9-bfac-424e-a79d-ed0d3e13b875 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e" status: 200 len: 1522 microversion: 2.1 time: 0.159216 Jun 16 19:00:51.879605 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 93/185] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:51 2022] GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:00:52.541398 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-cb60d901-7807-48f3-8173-ef5c9d3e2fa4 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:52.541925 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-cb60d901-7807-48f3-8173-ef5c9d3e2fa4 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] [instance: de7eb4c7-a555-44f0-84c2-428b23b31a2d] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:52.543871 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=1 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:00:52.549105 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-cb60d901-7807-48f3-8173-ef5c9d3e2fa4 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:52.549539 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-cb60d901-7807-48f3-8173-ef5c9d3e2fa4 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:52.550293 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-cb60d901-7807-48f3-8173-ef5c9d3e2fa4 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:52.550743 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-cb60d901-7807-48f3-8173-ef5c9d3e2fa4 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:52.553929 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_cell1:SELECT=100 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:00:52.683200 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-cb60d901-7807-48f3-8173-ef5c9d3e2fa4 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8813b3f6f8c46519fb827cf521bb37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de0652519d3447b8d0e4d948610071f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:52.692113 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-cb60d901-7807-48f3-8173-ef5c9d3e2fa4 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] 10.222.0.70 "GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d" status: 200 len: 1554 microversion: 2.1 time: 0.154591 Jun 16 19:00:52.692754 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 93/186] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:52 2022] GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:52.897599 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-19d7583e-42be-4959-82d6-2c7ae06d8f8c tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:52.897599 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-19d7583e-42be-4959-82d6-2c7ae06d8f8c tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1e6f9976-8df1-4719-a873-ab83b056f95e] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:52.904084 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-19d7583e-42be-4959-82d6-2c7ae06d8f8c tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:52.904742 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-19d7583e-42be-4959-82d6-2c7ae06d8f8c tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:52.905654 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-19d7583e-42be-4959-82d6-2c7ae06d8f8c tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:52.906085 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-19d7583e-42be-4959-82d6-2c7ae06d8f8c tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:53.052534 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-19d7583e-42be-4959-82d6-2c7ae06d8f8c tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:53.060850 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-19d7583e-42be-4959-82d6-2c7ae06d8f8c tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e" status: 200 len: 1522 microversion: 2.1 time: 0.168115 Jun 16 19:00:53.062208 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 94/187] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:52 2022] GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:53.709784 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-fa1e23b4-5fac-43e3-835d-e8559b1f065d tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:53.710393 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-fa1e23b4-5fac-43e3-835d-e8559b1f065d tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] [instance: de7eb4c7-a555-44f0-84c2-428b23b31a2d] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:53.717554 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-fa1e23b4-5fac-43e3-835d-e8559b1f065d tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:53.718042 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-fa1e23b4-5fac-43e3-835d-e8559b1f065d tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:53.718839 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-fa1e23b4-5fac-43e3-835d-e8559b1f065d tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:53.719311 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-fa1e23b4-5fac-43e3-835d-e8559b1f065d tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:53.892970 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-fa1e23b4-5fac-43e3-835d-e8559b1f065d tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8813b3f6f8c46519fb827cf521bb37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de0652519d3447b8d0e4d948610071f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:53.902404 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-fa1e23b4-5fac-43e3-835d-e8559b1f065d tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] 10.222.0.70 "GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d" status: 200 len: 1554 microversion: 2.1 time: 0.196508 Jun 16 19:00:53.904540 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 94/188] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:53 2022] GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d => generated 1554 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:54.079429 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-0c534e0c-e434-4315-928f-fbb87ae87c72 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:54.080745 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-0c534e0c-e434-4315-928f-fbb87ae87c72 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1e6f9976-8df1-4719-a873-ab83b056f95e] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:54.087571 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0c534e0c-e434-4315-928f-fbb87ae87c72 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:54.088023 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0c534e0c-e434-4315-928f-fbb87ae87c72 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:54.089002 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0c534e0c-e434-4315-928f-fbb87ae87c72 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:54.089448 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0c534e0c-e434-4315-928f-fbb87ae87c72 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:54.245845 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-0c534e0c-e434-4315-928f-fbb87ae87c72 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:54.256023 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-0c534e0c-e434-4315-928f-fbb87ae87c72 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e" status: 200 len: 1522 microversion: 2.1 time: 0.181028 Jun 16 19:00:54.256695 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 95/189] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:54 2022] GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:00:54.921045 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-35d1ba24-b494-497c-a523-f09b2ed7a984 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:54.921656 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-35d1ba24-b494-497c-a523-f09b2ed7a984 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] [instance: de7eb4c7-a555-44f0-84c2-428b23b31a2d] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:54.927808 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-35d1ba24-b494-497c-a523-f09b2ed7a984 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:54.928545 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-35d1ba24-b494-497c-a523-f09b2ed7a984 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:54.929009 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-35d1ba24-b494-497c-a523-f09b2ed7a984 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:54.929447 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-35d1ba24-b494-497c-a523-f09b2ed7a984 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:55.082614 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-35d1ba24-b494-497c-a523-f09b2ed7a984 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8813b3f6f8c46519fb827cf521bb37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de0652519d3447b8d0e4d948610071f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:55.090828 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-35d1ba24-b494-497c-a523-f09b2ed7a984 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] 10.222.0.70 "GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d" status: 200 len: 1554 microversion: 2.1 time: 0.174085 Jun 16 19:00:55.092292 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 95/190] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:54 2022] GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d => generated 1554 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:00:55.275088 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-0bcf2f18-9f36-4c7e-9c13-6922f3b27587 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:55.275703 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-0bcf2f18-9f36-4c7e-9c13-6922f3b27587 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1e6f9976-8df1-4719-a873-ab83b056f95e] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:55.297184 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:00:55.299276 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0bcf2f18-9f36-4c7e-9c13-6922f3b27587 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:55.299944 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0bcf2f18-9f36-4c7e-9c13-6922f3b27587 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:55.301579 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0bcf2f18-9f36-4c7e-9c13-6922f3b27587 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:55.302033 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0bcf2f18-9f36-4c7e-9c13-6922f3b27587 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:55.330586 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:00:55.532552 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-0bcf2f18-9f36-4c7e-9c13-6922f3b27587 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:55.544103 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-0bcf2f18-9f36-4c7e-9c13-6922f3b27587 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e" status: 200 len: 1522 microversion: 2.1 time: 0.273082 Jun 16 19:00:55.545839 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 96/191] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:55 2022] GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e => generated 1522 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:55.822784 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [req-c337914b-59af-4cbd-a432-f8a3fed71132 req-d1ef95f4-ac7d-466a-bf7e-8267c6935a1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de7eb4c7-a555-44f0-84c2-428b23b31a2d", "name": "network-vif-deleted", "tag": "77abca93-521b-4d16-a289-8aedb986871d"}]} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:00:55.832568 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-c337914b-59af-4cbd-a432-f8a3fed71132 req-d1ef95f4-ac7d-466a-bf7e-8267c6935a1f service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:55.833193 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-c337914b-59af-4cbd-a432-f8a3fed71132 req-d1ef95f4-ac7d-466a-bf7e-8267c6935a1f service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:55.847865 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.compute.server_external_events [req-c337914b-59af-4cbd-a432-f8a3fed71132 req-d1ef95f4-ac7d-466a-bf7e-8267c6935a1f service nova] Creating event network-vif-deleted:77abca93-521b-4d16-a289-8aedb986871d for instance de7eb4c7-a555-44f0-84c2-428b23b31a2d on hv-cinder-84617 Jun 16 19:00:55.854724 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [req-c337914b-59af-4cbd-a432-f8a3fed71132 req-d1ef95f4-ac7d-466a-bf7e-8267c6935a1f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035567 Jun 16 19:00:55.855575 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 96/192] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:00:56.116179 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-8d39c358-5e8f-4c50-b032-f03836777e61 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:56.117334 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-8d39c358-5e8f-4c50-b032-f03836777e61 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] [instance: de7eb4c7-a555-44f0-84c2-428b23b31a2d] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:56.146090 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-8d39c358-5e8f-4c50-b032-f03836777e61 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:56.146678 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-8d39c358-5e8f-4c50-b032-f03836777e61 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:56.147518 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-8d39c358-5e8f-4c50-b032-f03836777e61 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:56.148022 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-8d39c358-5e8f-4c50-b032-f03836777e61 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:56.265881 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-8d39c358-5e8f-4c50-b032-f03836777e61 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8813b3f6f8c46519fb827cf521bb37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de0652519d3447b8d0e4d948610071f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:56.281969 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-8d39c358-5e8f-4c50-b032-f03836777e61 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] 10.222.0.70 "GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d" status: 200 len: 1512 microversion: 2.1 time: 0.176647 Jun 16 19:00:56.294291 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 97/193] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:56 2022] GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d => generated 1512 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:56.562657 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-96fa3b7b-5da4-4b60-babe-aec4929f2a17 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:56.563504 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-96fa3b7b-5da4-4b60-babe-aec4929f2a17 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1e6f9976-8df1-4719-a873-ab83b056f95e] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:56.569944 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-96fa3b7b-5da4-4b60-babe-aec4929f2a17 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:56.570481 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-96fa3b7b-5da4-4b60-babe-aec4929f2a17 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:56.571502 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-96fa3b7b-5da4-4b60-babe-aec4929f2a17 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:56.572436 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-96fa3b7b-5da4-4b60-babe-aec4929f2a17 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:56.755210 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-96fa3b7b-5da4-4b60-babe-aec4929f2a17 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:56.763885 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-96fa3b7b-5da4-4b60-babe-aec4929f2a17 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e" status: 200 len: 1522 microversion: 2.1 time: 0.205755 Jun 16 19:00:56.775345 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 97/194] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:56 2022] GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:57.301748 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-5b702a1e-9bde-4a10-b349-9bccc280b3e7 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:57.302393 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-5b702a1e-9bde-4a10-b349-9bccc280b3e7 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] [instance: de7eb4c7-a555-44f0-84c2-428b23b31a2d] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:57.309636 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-5b702a1e-9bde-4a10-b349-9bccc280b3e7 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:57.310767 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-5b702a1e-9bde-4a10-b349-9bccc280b3e7 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:57.311751 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-5b702a1e-9bde-4a10-b349-9bccc280b3e7 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:57.312403 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-5b702a1e-9bde-4a10-b349-9bccc280b3e7 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:57.468492 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-5b702a1e-9bde-4a10-b349-9bccc280b3e7 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8813b3f6f8c46519fb827cf521bb37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de0652519d3447b8d0e4d948610071f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:57.482983 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-5b702a1e-9bde-4a10-b349-9bccc280b3e7 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] 10.222.0.70 "GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d" status: 200 len: 1346 microversion: 2.1 time: 0.184680 Jun 16 19:00:57.484570 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 98/195] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:57 2022] GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d => generated 1346 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:57.782329 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-68e30b31-594c-4fd2-8d0e-aabda1e5cb6c tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:57.783677 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-68e30b31-594c-4fd2-8d0e-aabda1e5cb6c tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1e6f9976-8df1-4719-a873-ab83b056f95e] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:57.790269 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-68e30b31-594c-4fd2-8d0e-aabda1e5cb6c tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:57.791007 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-68e30b31-594c-4fd2-8d0e-aabda1e5cb6c tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:57.791955 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-68e30b31-594c-4fd2-8d0e-aabda1e5cb6c tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:57.792662 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-68e30b31-594c-4fd2-8d0e-aabda1e5cb6c tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:57.936876 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-68e30b31-594c-4fd2-8d0e-aabda1e5cb6c tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:57.945142 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-68e30b31-594c-4fd2-8d0e-aabda1e5cb6c tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e" status: 200 len: 1522 microversion: 2.1 time: 0.166789 Jun 16 19:00:57.946308 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 98/196] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:57 2022] GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:58.500169 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-2ef6f583-c57a-46c5-abf7-643a918e8a6b tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:58.500809 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-2ef6f583-c57a-46c5-abf7-643a918e8a6b tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] [instance: de7eb4c7-a555-44f0-84c2-428b23b31a2d] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:58.511109 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-2ef6f583-c57a-46c5-abf7-643a918e8a6b tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:58.511550 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-2ef6f583-c57a-46c5-abf7-643a918e8a6b tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:58.512335 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-2ef6f583-c57a-46c5-abf7-643a918e8a6b tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:58.515746 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-2ef6f583-c57a-46c5-abf7-643a918e8a6b tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:58.676981 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-2ef6f583-c57a-46c5-abf7-643a918e8a6b tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8813b3f6f8c46519fb827cf521bb37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de0652519d3447b8d0e4d948610071f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:58.687655 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-2ef6f583-c57a-46c5-abf7-643a918e8a6b tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] 10.222.0.70 "GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d" status: 200 len: 1346 microversion: 2.1 time: 0.192185 Jun 16 19:00:58.701143 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 99/197] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:58 2022] GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d => generated 1346 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:58.970212 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-12cccf08-f429-457e-a8d1-cf585ce3d286 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:58.973543 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-12cccf08-f429-457e-a8d1-cf585ce3d286 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1e6f9976-8df1-4719-a873-ab83b056f95e] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:58.987057 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-12cccf08-f429-457e-a8d1-cf585ce3d286 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:58.987948 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-12cccf08-f429-457e-a8d1-cf585ce3d286 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:58.989105 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-12cccf08-f429-457e-a8d1-cf585ce3d286 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:58.990852 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-12cccf08-f429-457e-a8d1-cf585ce3d286 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:59.281815 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-12cccf08-f429-457e-a8d1-cf585ce3d286 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:59.299798 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-12cccf08-f429-457e-a8d1-cf585ce3d286 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e" status: 200 len: 1502 microversion: 2.1 time: 0.340914 Jun 16 19:00:59.300650 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 99/198] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:58 2022] GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e => generated 1502 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:59.318315 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-5d9853ac-fc4c-4b1a-ae3c-7c27c9bb5f8d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:59.318994 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-5d9853ac-fc4c-4b1a-ae3c-7c27c9bb5f8d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1407f346-2c64-41d0-b983-268e60273230] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:59.325506 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-5d9853ac-fc4c-4b1a-ae3c-7c27c9bb5f8d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:59.327772 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-5d9853ac-fc4c-4b1a-ae3c-7c27c9bb5f8d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:59.328963 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-5d9853ac-fc4c-4b1a-ae3c-7c27c9bb5f8d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:59.329611 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-5d9853ac-fc4c-4b1a-ae3c-7c27c9bb5f8d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:59.490630 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-5d9853ac-fc4c-4b1a-ae3c-7c27c9bb5f8d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:59.500029 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-5d9853ac-fc4c-4b1a-ae3c-7c27c9bb5f8d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1407f346-2c64-41d0-b983-268e60273230" status: 200 len: 1514 microversion: 2.1 time: 0.187999 Jun 16 19:00:59.502298 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 100/199] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:59 2022] GET /compute/v2.1/servers/1407f346-2c64-41d0-b983-268e60273230 => generated 1514 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:00:59.710881 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-7a385d55-4c0c-4654-8920-51612fc29ade tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:00:59.711669 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-7a385d55-4c0c-4654-8920-51612fc29ade tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] [instance: de7eb4c7-a555-44f0-84c2-428b23b31a2d] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:00:59.734624 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-7a385d55-4c0c-4654-8920-51612fc29ade tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:59.736752 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-7a385d55-4c0c-4654-8920-51612fc29ade tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:59.737669 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-7a385d55-4c0c-4654-8920-51612fc29ade tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:59.739941 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-7a385d55-4c0c-4654-8920-51612fc29ade tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:59.823823 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-7a385d55-4c0c-4654-8920-51612fc29ade tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:00:59.824308 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-7a385d55-4c0c-4654-8920-51612fc29ade tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:00:59.824880 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.objects.instance [None req-7a385d55-4c0c-4654-8920-51612fc29ade tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lazy-loading 'fault' on Instance uuid de7eb4c7-a555-44f0-84c2-428b23b31a2d {{(pid=117852) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:00:59.894360 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-7a385d55-4c0c-4654-8920-51612fc29ade tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8813b3f6f8c46519fb827cf521bb37b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de0652519d3447b8d0e4d948610071f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:00:59.906629 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-7a385d55-4c0c-4654-8920-51612fc29ade tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] 10.222.0.70 "GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d" status: 200 len: 1351 microversion: 2.1 time: 0.204840 Jun 16 19:00:59.908525 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 100/200] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:00:59 2022] GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d => generated 1351 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:00.925517 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-0fbd08f6-1dc9-46f3-8371-e7b3dd234912 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:00.926445 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-0fbd08f6-1dc9-46f3-8371-e7b3dd234912 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] [instance: de7eb4c7-a555-44f0-84c2-428b23b31a2d] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:00.938620 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0fbd08f6-1dc9-46f3-8371-e7b3dd234912 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:00.939180 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0fbd08f6-1dc9-46f3-8371-e7b3dd234912 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:00.940065 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0fbd08f6-1dc9-46f3-8371-e7b3dd234912 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:00.951675 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0fbd08f6-1dc9-46f3-8371-e7b3dd234912 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:00.995539 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.wsgi [None req-0fbd08f6-1dc9-46f3-8371-e7b3dd234912 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] HTTP exception thrown: Instance de7eb4c7-a555-44f0-84c2-428b23b31a2d could not be found. Jun 16 19:01:01.006011 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-0fbd08f6-1dc9-46f3-8371-e7b3dd234912 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Request method failure captured: Jun 16 19:01:01.006011 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: request: GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d HTTP/1.1 Jun 16 19:01:01.006011 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Accept: application/json Jun 16 19:01:01.006011 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Accept-Encoding: identity Jun 16 19:01:01.006011 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Connection: close Jun 16 19:01:01.006011 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Content-Length: 0 Jun 16 19:01:01.006011 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Content-Type: application/json Jun 16 19:01:01.006011 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Host: 10.222.0.70 Jun 16 19:01:01.006011 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Openstack-System-Scope: None Jun 16 19:01:01.006011 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: User-Agent: python-urllib3/1.26.9 Jun 16 19:01:01.006011 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Auth-Token: gAAAAABiq32MgAbTSUrw09S3fL6LvdCRtlkDbOT_KeOaTqRw6_pVRZyQ9bVrdlaY3DhJkCSJuoomdS1eUpHwb_gS7JP61uIf0ej3lF1YO-GoLUrC-AmrOX_PsIUqHaIZphsxhI3f4jZcPqkeMB94ZbpUmv5LzUpdfm5FnlvzZhp3K_JMDB6k6y8 Jun 16 19:01:01.006011 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Domain-Id: None Jun 16 19:01:01.006011 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Domain-Name: None Jun 16 19:01:01.006011 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Identity-Status: Confirmed Jun 16 19:01:01.006011 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Is-Admin-Project: True Jun 16 19:01:01.006011 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Domain-Id: default Jun 16 19:01:01.006011 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Domain-Name: Default Jun 16 19:01:01.006011 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Id: 7de0652519d3447b8d0e4d948610071f Jun 16 19:01:01.006011 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Name: tempest-DeleteServersTestJSON-935741698 Jun 16 19:01:01.006011 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Role: member,reader Jun 16 19:01:01.006011 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Roles: member,reader Jun 16 19:01:01.007775 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7de0652519d3447b8d0e4d948610071f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7de0652519d3447b8d0e4d948610071f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7de0652519d3447b8d0e4d948610071f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7de0652519d3447b8d0e4d948610071f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 16 19:01:01.007775 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant: tempest-DeleteServersTestJSON-935741698 Jun 16 19:01:01.007775 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant-Id: 7de0652519d3447b8d0e4d948610071f Jun 16 19:01:01.007775 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant-Name: tempest-DeleteServersTestJSON-935741698 Jun 16 19:01:01.007775 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User: tempest-DeleteServersTestJSON-935741698-project Jun 16 19:01:01.007775 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Domain-Id: default Jun 16 19:01:01.007775 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Domain-Name: Default Jun 16 19:01:01.007775 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Id: e8813b3f6f8c46519fb827cf521bb37b Jun 16 19:01:01.007775 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Name: tempest-DeleteServersTestJSON-935741698-project Jun 16 19:01:01.007775 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: method: > Jun 16 19:01:01.007775 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: exception: Instance de7eb4c7-a555-44f0-84c2-428b23b31a2d could not be found. Jun 16 19:01:01.007775 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: action_args: {'id': 'de7eb4c7-a555-44f0-84c2-428b23b31a2d'} Jun 16 19:01:01.008731 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:01:01.008731 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:01:01.008731 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:01:01.008731 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:01:01.008731 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:01:01.008731 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:01:01.008731 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:01:01.008731 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:01:01.008731 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:01:01.008731 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:01:01.008731 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de7eb4c7-a555-44f0-84c2-428b23b31a2d could not be found. Jun 16 19:01:01.008731 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:01:01.008731 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:01:01.008731 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:01:01.008731 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:01:01.008731 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:01:01.008731 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:01:01.008731 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:01:01.008731 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:01:01.008731 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:01:01.010252 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:01:01.010252 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:01:01.010252 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:01:01.010252 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:01:01.010252 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:01:01.010252 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:01:01.010252 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:01:01.010252 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de7eb4c7-a555-44f0-84c2-428b23b31a2d could not be found. Jun 16 19:01:01.010252 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:01:01.010252 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:01:01.010252 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:01:01.010252 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:01:01.010252 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:01:01.010252 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:01:01.010252 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:01:01.010252 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:01:01.010252 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de7eb4c7-a555-44f0-84c2-428b23b31a2d could not be found. Jun 16 19:01:01.010252 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:01:01.011595 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-0fbd08f6-1dc9-46f3-8371-e7b3dd234912 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Returning 404 to user: Instance de7eb4c7-a555-44f0-84c2-428b23b31a2d could not be found. {{(pid=117850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:01:01.011595 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-0fbd08f6-1dc9-46f3-8371-e7b3dd234912 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] 10.222.0.70 "GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d" status: 404 len: 111 microversion: 2.1 time: 0.085945 Jun 16 19:01:01.029956 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 101/201] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:00 2022] GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:01:01.221865 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-3dc466ae-8637-42a6-83c2-34a2019e22d9 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:01:01.226407 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-3dc466ae-8637-42a6-83c2-34a2019e22d9 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1407f346-2c64-41d0-b983-268e60273230] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:01.242034 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-3dc466ae-8637-42a6-83c2-34a2019e22d9 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:01.242927 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-3dc466ae-8637-42a6-83c2-34a2019e22d9 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:01.243879 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-3dc466ae-8637-42a6-83c2-34a2019e22d9 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:01.244511 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-3dc466ae-8637-42a6-83c2-34a2019e22d9 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:01.255606 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-90bc52eb-9c66-4d45-9532-336e9beb3ce5 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:01.256643 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-90bc52eb-9c66-4d45-9532-336e9beb3ce5 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] [instance: de7eb4c7-a555-44f0-84c2-428b23b31a2d] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:01.263973 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-90bc52eb-9c66-4d45-9532-336e9beb3ce5 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:01.264265 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-90bc52eb-9c66-4d45-9532-336e9beb3ce5 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:01.275433 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-90bc52eb-9c66-4d45-9532-336e9beb3ce5 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:01.276570 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-90bc52eb-9c66-4d45-9532-336e9beb3ce5 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:01.302086 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.wsgi [None req-90bc52eb-9c66-4d45-9532-336e9beb3ce5 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] HTTP exception thrown: Instance de7eb4c7-a555-44f0-84c2-428b23b31a2d could not be found. Jun 16 19:01:01.303049 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.objects.instance [None req-3dc466ae-8637-42a6-83c2-34a2019e22d9 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lazy-loading 'flavor' on Instance uuid 1407f346-2c64-41d0-b983-268e60273230 {{(pid=117852) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:01:01.308953 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-90bc52eb-9c66-4d45-9532-336e9beb3ce5 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Request method failure captured: Jun 16 19:01:01.308953 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: request: GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d/os-volume_attachments HTTP/1.1 Jun 16 19:01:01.308953 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Accept: application/json Jun 16 19:01:01.308953 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Accept-Encoding: identity Jun 16 19:01:01.308953 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Connection: close Jun 16 19:01:01.308953 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Content-Length: 0 Jun 16 19:01:01.308953 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Content-Type: application/json Jun 16 19:01:01.308953 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Host: 10.222.0.70 Jun 16 19:01:01.308953 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Openstack-System-Scope: None Jun 16 19:01:01.308953 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: User-Agent: python-urllib3/1.26.9 Jun 16 19:01:01.308953 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Auth-Token: gAAAAABiq32MgAbTSUrw09S3fL6LvdCRtlkDbOT_KeOaTqRw6_pVRZyQ9bVrdlaY3DhJkCSJuoomdS1eUpHwb_gS7JP61uIf0ej3lF1YO-GoLUrC-AmrOX_PsIUqHaIZphsxhI3f4jZcPqkeMB94ZbpUmv5LzUpdfm5FnlvzZhp3K_JMDB6k6y8 Jun 16 19:01:01.308953 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Domain-Id: None Jun 16 19:01:01.308953 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Domain-Name: None Jun 16 19:01:01.308953 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Identity-Status: Confirmed Jun 16 19:01:01.308953 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Is-Admin-Project: True Jun 16 19:01:01.308953 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Domain-Id: default Jun 16 19:01:01.308953 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Domain-Name: Default Jun 16 19:01:01.308953 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Id: 7de0652519d3447b8d0e4d948610071f Jun 16 19:01:01.308953 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Name: tempest-DeleteServersTestJSON-935741698 Jun 16 19:01:01.308953 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Role: member,reader Jun 16 19:01:01.308953 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Roles: member,reader Jun 16 19:01:01.310950 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7de0652519d3447b8d0e4d948610071f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7de0652519d3447b8d0e4d948610071f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7de0652519d3447b8d0e4d948610071f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7de0652519d3447b8d0e4d948610071f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 16 19:01:01.310950 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant: tempest-DeleteServersTestJSON-935741698 Jun 16 19:01:01.310950 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant-Id: 7de0652519d3447b8d0e4d948610071f Jun 16 19:01:01.310950 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant-Name: tempest-DeleteServersTestJSON-935741698 Jun 16 19:01:01.310950 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User: tempest-DeleteServersTestJSON-935741698-project Jun 16 19:01:01.310950 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Domain-Id: default Jun 16 19:01:01.310950 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Domain-Name: Default Jun 16 19:01:01.310950 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Id: e8813b3f6f8c46519fb827cf521bb37b Jun 16 19:01:01.310950 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Name: tempest-DeleteServersTestJSON-935741698-project Jun 16 19:01:01.310950 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: method: > Jun 16 19:01:01.310950 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: exception: Instance de7eb4c7-a555-44f0-84c2-428b23b31a2d could not be found. Jun 16 19:01:01.310950 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: action_args: {'server_id': 'de7eb4c7-a555-44f0-84c2-428b23b31a2d'} Jun 16 19:01:01.311893 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:01:01.311893 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:01:01.311893 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:01:01.311893 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:01:01.311893 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:01:01.311893 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:01:01.311893 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:01:01.311893 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:01:01.311893 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:01:01.311893 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:01:01.311893 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de7eb4c7-a555-44f0-84c2-428b23b31a2d could not be found. Jun 16 19:01:01.311893 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:01:01.311893 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:01:01.311893 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:01:01.311893 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:01:01.311893 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:01:01.311893 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:01:01.311893 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:01:01.311893 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:01:01.311893 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:01:01.313899 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:01:01.313899 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 16 19:01:01.313899 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 19:01:01.313899 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 16 19:01:01.313899 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 19:01:01.313899 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 16 19:01:01.313899 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 16 19:01:01.313899 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:01:01.313899 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:01:01.313899 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de7eb4c7-a555-44f0-84c2-428b23b31a2d could not be found. Jun 16 19:01:01.313899 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:01:01.313899 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:01:01.313899 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:01:01.313899 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:01:01.313899 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:01:01.313899 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:01:01.313899 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:01:01.313899 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:01:01.313899 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de7eb4c7-a555-44f0-84c2-428b23b31a2d could not be found. Jun 16 19:01:01.313899 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:01:01.318179 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-90bc52eb-9c66-4d45-9532-336e9beb3ce5 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Returning 404 to user: Instance de7eb4c7-a555-44f0-84c2-428b23b31a2d could not be found. {{(pid=117850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:01:01.320366 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-90bc52eb-9c66-4d45-9532-336e9beb3ce5 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] 10.222.0.70 "GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.068094 Jun 16 19:01:01.321166 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 102/202] 10.222.0.70 () {58 vars in 1301 bytes} [Thu Jun 16 19:01:01 2022] GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d/os-volume_attachments => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:01:01.441183 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-3dc466ae-8637-42a6-83c2-34a2019e22d9 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "POST /compute/v2.1/servers/1407f346-2c64-41d0-b983-268e60273230/action" status: 200 len: 32 microversion: 2.1 time: 0.225405 Jun 16 19:01:01.447993 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 101/203] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Jun 16 19:01:01 2022] POST /compute/v2.1/servers/1407f346-2c64-41d0-b983-268e60273230/action => generated 32 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 19:01:01.452749 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-af0f22e1-82d3-4dfc-9009-b5e203644687 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:01.453656 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-af0f22e1-82d3-4dfc-9009-b5e203644687 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1407f346-2c64-41d0-b983-268e60273230] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:01.467622 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-af0f22e1-82d3-4dfc-9009-b5e203644687 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:01.469727 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-af0f22e1-82d3-4dfc-9009-b5e203644687 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:01.471509 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-af0f22e1-82d3-4dfc-9009-b5e203644687 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:01.472242 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-af0f22e1-82d3-4dfc-9009-b5e203644687 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:01.673373 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-af0f22e1-82d3-4dfc-9009-b5e203644687 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:01.688415 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-af0f22e1-82d3-4dfc-9009-b5e203644687 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1407f346-2c64-41d0-b983-268e60273230" status: 200 len: 1520 microversion: 2.1 time: 0.240899 Jun 16 19:01:01.689505 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 103/204] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:01 2022] GET /compute/v2.1/servers/1407f346-2c64-41d0-b983-268e60273230 => generated 1520 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:02.644484 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-a0c46a01-476e-47a0-be72-7ff7e14ca4c7 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:02.645190 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-a0c46a01-476e-47a0-be72-7ff7e14ca4c7 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] [instance: de7eb4c7-a555-44f0-84c2-428b23b31a2d] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:02.655900 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-a0c46a01-476e-47a0-be72-7ff7e14ca4c7 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:02.657072 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-a0c46a01-476e-47a0-be72-7ff7e14ca4c7 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:02.659552 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-a0c46a01-476e-47a0-be72-7ff7e14ca4c7 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:02.660655 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-a0c46a01-476e-47a0-be72-7ff7e14ca4c7 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:02.692759 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.wsgi [None req-a0c46a01-476e-47a0-be72-7ff7e14ca4c7 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] HTTP exception thrown: Instance de7eb4c7-a555-44f0-84c2-428b23b31a2d could not be found. Jun 16 19:01:02.698701 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-a0c46a01-476e-47a0-be72-7ff7e14ca4c7 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Request method failure captured: Jun 16 19:01:02.698701 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: request: DELETE /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d HTTP/1.1 Jun 16 19:01:02.698701 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Accept: application/json Jun 16 19:01:02.698701 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Accept-Encoding: identity Jun 16 19:01:02.698701 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Connection: close Jun 16 19:01:02.698701 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Content-Length: 0 Jun 16 19:01:02.698701 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Content-Type: application/json Jun 16 19:01:02.698701 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Host: 10.222.0.70 Jun 16 19:01:02.698701 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Openstack-System-Scope: None Jun 16 19:01:02.698701 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: User-Agent: python-urllib3/1.26.9 Jun 16 19:01:02.698701 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Auth-Token: gAAAAABiq32MgAbTSUrw09S3fL6LvdCRtlkDbOT_KeOaTqRw6_pVRZyQ9bVrdlaY3DhJkCSJuoomdS1eUpHwb_gS7JP61uIf0ej3lF1YO-GoLUrC-AmrOX_PsIUqHaIZphsxhI3f4jZcPqkeMB94ZbpUmv5LzUpdfm5FnlvzZhp3K_JMDB6k6y8 Jun 16 19:01:02.698701 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Domain-Id: None Jun 16 19:01:02.698701 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Domain-Name: None Jun 16 19:01:02.698701 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Identity-Status: Confirmed Jun 16 19:01:02.698701 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Is-Admin-Project: True Jun 16 19:01:02.698701 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Domain-Id: default Jun 16 19:01:02.698701 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Domain-Name: Default Jun 16 19:01:02.698701 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Id: 7de0652519d3447b8d0e4d948610071f Jun 16 19:01:02.698701 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Name: tempest-DeleteServersTestJSON-935741698 Jun 16 19:01:02.698701 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Role: member,reader Jun 16 19:01:02.698701 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Roles: member,reader Jun 16 19:01:02.699994 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7de0652519d3447b8d0e4d948610071f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7de0652519d3447b8d0e4d948610071f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7de0652519d3447b8d0e4d948610071f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7de0652519d3447b8d0e4d948610071f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 16 19:01:02.699994 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant: tempest-DeleteServersTestJSON-935741698 Jun 16 19:01:02.699994 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant-Id: 7de0652519d3447b8d0e4d948610071f Jun 16 19:01:02.699994 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant-Name: tempest-DeleteServersTestJSON-935741698 Jun 16 19:01:02.699994 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User: tempest-DeleteServersTestJSON-935741698-project Jun 16 19:01:02.699994 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Domain-Id: default Jun 16 19:01:02.699994 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Domain-Name: Default Jun 16 19:01:02.699994 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Id: e8813b3f6f8c46519fb827cf521bb37b Jun 16 19:01:02.699994 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Name: tempest-DeleteServersTestJSON-935741698-project Jun 16 19:01:02.699994 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: method: > Jun 16 19:01:02.699994 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: exception: Instance de7eb4c7-a555-44f0-84c2-428b23b31a2d could not be found. Jun 16 19:01:02.699994 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: action_args: {'id': 'de7eb4c7-a555-44f0-84c2-428b23b31a2d'} Jun 16 19:01:02.702525 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:01:02.702525 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:01:02.702525 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:01:02.702525 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:01:02.702525 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:01:02.702525 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:01:02.702525 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:01:02.702525 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:01:02.702525 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:01:02.702525 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:01:02.702525 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de7eb4c7-a555-44f0-84c2-428b23b31a2d could not be found. Jun 16 19:01:02.702525 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:01:02.702525 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:01:02.702525 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:01:02.702525 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:01:02.702525 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:01:02.702525 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:01:02.702525 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:01:02.702525 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:01:02.702525 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:01:02.703715 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:01:02.703715 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 19:01:02.703715 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 19:01:02.703715 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 19:01:02.703715 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 19:01:02.703715 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:01:02.703715 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:01:02.703715 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:01:02.703715 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:01:02.703715 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de7eb4c7-a555-44f0-84c2-428b23b31a2d could not be found. Jun 16 19:01:02.703715 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:01:02.703715 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:01:02.703715 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:01:02.703715 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:01:02.703715 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:01:02.703715 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:01:02.703715 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:01:02.703715 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:01:02.703715 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de7eb4c7-a555-44f0-84c2-428b23b31a2d could not be found. Jun 16 19:01:02.703715 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:01:02.706256 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-a0c46a01-476e-47a0-be72-7ff7e14ca4c7 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Returning 404 to user: Instance de7eb4c7-a555-44f0-84c2-428b23b31a2d could not be found. {{(pid=117852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:01:02.706256 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-a0c46a01-476e-47a0-be72-7ff7e14ca4c7 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] 10.222.0.70 "DELETE /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d" status: 404 len: 111 microversion: 2.1 time: 0.063517 Jun 16 19:01:02.706256 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 102/205] 10.222.0.70 () {58 vars in 1238 bytes} [Thu Jun 16 19:01:02 2022] DELETE /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:01:02.710743 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-642b8b1a-0f4e-42a0-8dcc-e86ecfc2a011 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:02.711954 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-642b8b1a-0f4e-42a0-8dcc-e86ecfc2a011 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1407f346-2c64-41d0-b983-268e60273230] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:02.727933 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-642b8b1a-0f4e-42a0-8dcc-e86ecfc2a011 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:02.728305 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-642b8b1a-0f4e-42a0-8dcc-e86ecfc2a011 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:02.729363 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-642b8b1a-0f4e-42a0-8dcc-e86ecfc2a011 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:02.729916 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-6c1c3c6c-a848-4870-8931-8255b108c192 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:02.730918 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-6c1c3c6c-a848-4870-8931-8255b108c192 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] [instance: de7eb4c7-a555-44f0-84c2-428b23b31a2d] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:02.732128 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-642b8b1a-0f4e-42a0-8dcc-e86ecfc2a011 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:02.748114 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-6c1c3c6c-a848-4870-8931-8255b108c192 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:02.748745 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-6c1c3c6c-a848-4870-8931-8255b108c192 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:02.749644 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-6c1c3c6c-a848-4870-8931-8255b108c192 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:02.750378 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-6c1c3c6c-a848-4870-8931-8255b108c192 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:02.770448 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.wsgi [None req-6c1c3c6c-a848-4870-8931-8255b108c192 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] HTTP exception thrown: Instance de7eb4c7-a555-44f0-84c2-428b23b31a2d could not be found. Jun 16 19:01:02.784562 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-6c1c3c6c-a848-4870-8931-8255b108c192 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Request method failure captured: Jun 16 19:01:02.784562 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: request: GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d HTTP/1.1 Jun 16 19:01:02.784562 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Accept: application/json Jun 16 19:01:02.784562 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Accept-Encoding: identity Jun 16 19:01:02.784562 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Connection: close Jun 16 19:01:02.784562 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Content-Length: 0 Jun 16 19:01:02.784562 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Content-Type: application/json Jun 16 19:01:02.784562 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Host: 10.222.0.70 Jun 16 19:01:02.784562 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Openstack-System-Scope: None Jun 16 19:01:02.784562 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: User-Agent: python-urllib3/1.26.9 Jun 16 19:01:02.784562 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Auth-Token: gAAAAABiq32MgAbTSUrw09S3fL6LvdCRtlkDbOT_KeOaTqRw6_pVRZyQ9bVrdlaY3DhJkCSJuoomdS1eUpHwb_gS7JP61uIf0ej3lF1YO-GoLUrC-AmrOX_PsIUqHaIZphsxhI3f4jZcPqkeMB94ZbpUmv5LzUpdfm5FnlvzZhp3K_JMDB6k6y8 Jun 16 19:01:02.784562 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Domain-Id: None Jun 16 19:01:02.784562 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Domain-Name: None Jun 16 19:01:02.784562 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Identity-Status: Confirmed Jun 16 19:01:02.784562 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Is-Admin-Project: True Jun 16 19:01:02.784562 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Domain-Id: default Jun 16 19:01:02.784562 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Domain-Name: Default Jun 16 19:01:02.784562 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Id: 7de0652519d3447b8d0e4d948610071f Jun 16 19:01:02.784562 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Name: tempest-DeleteServersTestJSON-935741698 Jun 16 19:01:02.784562 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Role: member,reader Jun 16 19:01:02.784562 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Roles: member,reader Jun 16 19:01:02.786419 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7de0652519d3447b8d0e4d948610071f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7de0652519d3447b8d0e4d948610071f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7de0652519d3447b8d0e4d948610071f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7de0652519d3447b8d0e4d948610071f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 16 19:01:02.786419 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant: tempest-DeleteServersTestJSON-935741698 Jun 16 19:01:02.786419 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant-Id: 7de0652519d3447b8d0e4d948610071f Jun 16 19:01:02.786419 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant-Name: tempest-DeleteServersTestJSON-935741698 Jun 16 19:01:02.786419 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User: tempest-DeleteServersTestJSON-935741698-project Jun 16 19:01:02.786419 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Domain-Id: default Jun 16 19:01:02.786419 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Domain-Name: Default Jun 16 19:01:02.786419 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Id: e8813b3f6f8c46519fb827cf521bb37b Jun 16 19:01:02.786419 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Name: tempest-DeleteServersTestJSON-935741698-project Jun 16 19:01:02.786419 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: method: > Jun 16 19:01:02.786419 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: exception: Instance de7eb4c7-a555-44f0-84c2-428b23b31a2d could not be found. Jun 16 19:01:02.786419 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: action_args: {'id': 'de7eb4c7-a555-44f0-84c2-428b23b31a2d'} Jun 16 19:01:02.787231 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:01:02.787231 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:01:02.787231 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:01:02.787231 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:01:02.787231 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:01:02.787231 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:01:02.787231 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:01:02.787231 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:01:02.787231 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:01:02.787231 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:01:02.787231 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de7eb4c7-a555-44f0-84c2-428b23b31a2d could not be found. Jun 16 19:01:02.787231 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:01:02.787231 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:01:02.787231 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:01:02.787231 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:01:02.787231 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:01:02.787231 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:01:02.787231 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:01:02.787231 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:01:02.787231 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:01:02.788633 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:01:02.788633 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:01:02.788633 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:01:02.788633 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:01:02.788633 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:01:02.788633 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:01:02.788633 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:01:02.788633 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de7eb4c7-a555-44f0-84c2-428b23b31a2d could not be found. Jun 16 19:01:02.788633 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:01:02.788633 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:01:02.788633 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:01:02.788633 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:01:02.788633 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:01:02.788633 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:01:02.788633 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:01:02.788633 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:01:02.788633 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de7eb4c7-a555-44f0-84c2-428b23b31a2d could not be found. Jun 16 19:01:02.788633 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:01:02.790550 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-6c1c3c6c-a848-4870-8931-8255b108c192 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] Returning 404 to user: Instance de7eb4c7-a555-44f0-84c2-428b23b31a2d could not be found. {{(pid=117852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:01:02.791345 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-6c1c3c6c-a848-4870-8931-8255b108c192 tempest-DeleteServersTestJSON-935741698 tempest-DeleteServersTestJSON-935741698-project] 10.222.0.70 "GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d" status: 404 len: 111 microversion: 2.1 time: 0.073078 Jun 16 19:01:02.792364 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 103/206] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:02 2022] GET /compute/v2.1/servers/de7eb4c7-a555-44f0-84c2-428b23b31a2d => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:01:03.082886 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-642b8b1a-0f4e-42a0-8dcc-e86ecfc2a011 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:03.094160 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-642b8b1a-0f4e-42a0-8dcc-e86ecfc2a011 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1407f346-2c64-41d0-b983-268e60273230" status: 200 len: 1520 microversion: 2.1 time: 0.387594 Jun 16 19:01:03.109762 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 104/207] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:02 2022] GET /compute/v2.1/servers/1407f346-2c64-41d0-b983-268e60273230 => generated 1520 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:04.119762 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-ac565868-6dc2-4117-b603-d9dce6b58531 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:04.120537 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-ac565868-6dc2-4117-b603-d9dce6b58531 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1407f346-2c64-41d0-b983-268e60273230] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:04.137978 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ac565868-6dc2-4117-b603-d9dce6b58531 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:04.139104 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ac565868-6dc2-4117-b603-d9dce6b58531 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:04.141384 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ac565868-6dc2-4117-b603-d9dce6b58531 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:04.142160 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ac565868-6dc2-4117-b603-d9dce6b58531 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:05.000025 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-ac565868-6dc2-4117-b603-d9dce6b58531 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:05.017756 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-ac565868-6dc2-4117-b603-d9dce6b58531 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1407f346-2c64-41d0-b983-268e60273230" status: 200 len: 1520 microversion: 2.1 time: 0.897605 Jun 16 19:01:05.017756 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 104/208] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:04 2022] GET /compute/v2.1/servers/1407f346-2c64-41d0-b983-268e60273230 => generated 1520 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:05.024414 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-6775816a-4481-4e02-8f83-9df5223db60a tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1384761090", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-316787948", "security_groups": [{"name": "tempest-secgroup-smoke-332400561"}], "networks": [{"uuid": "f1897a12-c10c-49b5-bf28-06da7210742b"}], "block_device_mapping_v2": [{"uuid": "b477b361-32a1-4695-a18f-1dd2a84a5f74", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:01:05.558147 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.network.neutron [None req-6775816a-4481-4e02-8f83-9df5223db60a tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] validate_networks() for [('f1897a12-c10c-49b5-bf28-06da7210742b', None, None, None, None, None)] {{(pid=117850) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:01:06.025674 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-529326fb-525e-4fa6-bd4b-a5ae8d24388c tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:06.027046 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-529326fb-525e-4fa6-bd4b-a5ae8d24388c tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1407f346-2c64-41d0-b983-268e60273230] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:06.043107 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-529326fb-525e-4fa6-bd4b-a5ae8d24388c tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:06.043577 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-529326fb-525e-4fa6-bd4b-a5ae8d24388c tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:06.048712 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-529326fb-525e-4fa6-bd4b-a5ae8d24388c tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:06.049264 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-529326fb-525e-4fa6-bd4b-a5ae8d24388c tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:06.449045 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-6775816a-4481-4e02-8f83-9df5223db60a tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Flavor limits 0:0:0 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:01:06.449579 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-6775816a-4481-4e02-8f83-9df5223db60a tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Image limits 0:0:0 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:01:06.450026 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-6775816a-4481-4e02-8f83-9df5223db60a tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Flavor pref 0:0:0 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:01:06.450541 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-6775816a-4481-4e02-8f83-9df5223db60a tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Image pref 0:0:0 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:01:06.451006 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-6775816a-4481-4e02-8f83-9df5223db60a tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:01:06.586225 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-529326fb-525e-4fa6-bd4b-a5ae8d24388c tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:06.600786 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-529326fb-525e-4fa6-bd4b-a5ae8d24388c tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1407f346-2c64-41d0-b983-268e60273230" status: 200 len: 1520 microversion: 2.1 time: 0.575917 Jun 16 19:01:06.606099 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 105/209] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:06 2022] GET /compute/v2.1/servers/1407f346-2c64-41d0-b983-268e60273230 => generated 1520 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:06.790601 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-6775816a-4481-4e02-8f83-9df5223db60a tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:06.791425 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-6775816a-4481-4e02-8f83-9df5223db60a tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:06.793388 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-6775816a-4481-4e02-8f83-9df5223db60a tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:06.795420 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-6775816a-4481-4e02-8f83-9df5223db60a tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:06.828617 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.quota [None req-6775816a-4481-4e02-8f83-9df5223db60a tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Getting quotas for project 629634dc3dc54893b68cb9c9dc08505d. Resources: {'cores', 'ram', 'instances'} {{(pid=117850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:01:06.836229 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.quota [None req-6775816a-4481-4e02-8f83-9df5223db60a tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Getting quotas for user 27db09b804fa426a83f103cf5dd116a8 and project 629634dc3dc54893b68cb9c9dc08505d. Resources: {'cores', 'ram', 'instances'} {{(pid=117850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:01:06.980287 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-6775816a-4481-4e02-8f83-9df5223db60a tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Going to run 1 instances... {{(pid=117850) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:01:06.990520 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-6775816a-4481-4e02-8f83-9df5223db60a tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] [instance: c4277200-c999-4c53-85de-b2a8b120cd6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b477b361-32a1-4695-a18f-1dd2a84a5f74',volume_size=None,volume_type=None)] {{(pid=117850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:01:07.460724 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-6775816a-4481-4e02-8f83-9df5223db60a tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.440162 Jun 16 19:01:07.468510 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 105/210] 10.222.0.70 () {60 vars in 1146 bytes} [Thu Jun 16 19:01:05 2022] POST /compute/v2.1/servers => generated 405 bytes in 2449 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:01:07.486038 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-eedd239e-9bc5-42e9-bde0-25ab81b209af tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:07.490905 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-eedd239e-9bc5-42e9-bde0-25ab81b209af tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] [instance: c4277200-c999-4c53-85de-b2a8b120cd6d] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:07.620224 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-c046e97e-0493-4379-b95e-e5cbcafe8563 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:07.621001 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-c046e97e-0493-4379-b95e-e5cbcafe8563 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1407f346-2c64-41d0-b983-268e60273230] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:07.640933 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-c046e97e-0493-4379-b95e-e5cbcafe8563 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:07.643055 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-c046e97e-0493-4379-b95e-e5cbcafe8563 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:07.643970 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-c046e97e-0493-4379-b95e-e5cbcafe8563 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:07.644538 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-c046e97e-0493-4379-b95e-e5cbcafe8563 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:08.038159 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-eedd239e-9bc5-42e9-bde0-25ab81b209af tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27db09b804fa426a83f103cf5dd116a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629634dc3dc54893b68cb9c9dc08505d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:08.060427 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-eedd239e-9bc5-42e9-bde0-25ab81b209af tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] 10.222.0.70 "GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d" status: 200 len: 1088 microversion: 2.1 time: 0.581278 Jun 16 19:01:08.061434 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 106/211] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:07 2022] GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d => generated 1088 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:08.672980 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-c046e97e-0493-4379-b95e-e5cbcafe8563 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:08.722825 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-c046e97e-0493-4379-b95e-e5cbcafe8563 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1407f346-2c64-41d0-b983-268e60273230" status: 200 len: 1520 microversion: 2.1 time: 1.105368 Jun 16 19:01:08.725954 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 106/212] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:07 2022] GET /compute/v2.1/servers/1407f346-2c64-41d0-b983-268e60273230 => generated 1520 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:01:09.084177 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-40c51711-0d76-4ba8-9814-ceb4cc755b0a tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:09.086237 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-40c51711-0d76-4ba8-9814-ceb4cc755b0a tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] [instance: c4277200-c999-4c53-85de-b2a8b120cd6d] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:09.098423 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-40c51711-0d76-4ba8-9814-ceb4cc755b0a tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:09.100592 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-40c51711-0d76-4ba8-9814-ceb4cc755b0a tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:09.103251 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-40c51711-0d76-4ba8-9814-ceb4cc755b0a tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:09.105051 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-40c51711-0d76-4ba8-9814-ceb4cc755b0a tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:09.346236 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-40c51711-0d76-4ba8-9814-ceb4cc755b0a tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27db09b804fa426a83f103cf5dd116a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629634dc3dc54893b68cb9c9dc08505d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:09.354896 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-40c51711-0d76-4ba8-9814-ceb4cc755b0a tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] 10.222.0.70 "GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d" status: 200 len: 1138 microversion: 2.1 time: 0.275162 Jun 16 19:01:09.361693 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 107/213] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:09 2022] GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d => generated 1138 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:09.745069 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-52ea2453-bae3-4727-8af6-d862bde0eff6 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:09.746298 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-52ea2453-bae3-4727-8af6-d862bde0eff6 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1407f346-2c64-41d0-b983-268e60273230] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:09.773482 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-52ea2453-bae3-4727-8af6-d862bde0eff6 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:09.774327 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-52ea2453-bae3-4727-8af6-d862bde0eff6 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:09.776788 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-52ea2453-bae3-4727-8af6-d862bde0eff6 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:09.777536 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-52ea2453-bae3-4727-8af6-d862bde0eff6 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:10.382150 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-7fa4b2b2-7549-4a48-bdf6-8da094765b70 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:10.382918 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-7fa4b2b2-7549-4a48-bdf6-8da094765b70 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] [instance: c4277200-c999-4c53-85de-b2a8b120cd6d] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:10.398352 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-7fa4b2b2-7549-4a48-bdf6-8da094765b70 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:10.399046 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-7fa4b2b2-7549-4a48-bdf6-8da094765b70 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:10.399952 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-7fa4b2b2-7549-4a48-bdf6-8da094765b70 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:10.404330 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-7fa4b2b2-7549-4a48-bdf6-8da094765b70 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:10.484351 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-52ea2453-bae3-4727-8af6-d862bde0eff6 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:10.496052 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-52ea2453-bae3-4727-8af6-d862bde0eff6 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1407f346-2c64-41d0-b983-268e60273230" status: 200 len: 1520 microversion: 2.1 time: 0.756454 Jun 16 19:01:10.497710 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 107/214] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:09 2022] GET /compute/v2.1/servers/1407f346-2c64-41d0-b983-268e60273230 => generated 1520 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:10.589936 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-7fa4b2b2-7549-4a48-bdf6-8da094765b70 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27db09b804fa426a83f103cf5dd116a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629634dc3dc54893b68cb9c9dc08505d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:10.602024 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-7fa4b2b2-7549-4a48-bdf6-8da094765b70 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] 10.222.0.70 "GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d" status: 200 len: 1204 microversion: 2.1 time: 0.225306 Jun 16 19:01:10.603007 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 108/215] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:10 2022] GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d => generated 1204 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:11.514405 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-1a89d173-da24-4107-a681-131fe224377f tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:11.515318 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-1a89d173-da24-4107-a681-131fe224377f tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1407f346-2c64-41d0-b983-268e60273230] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:11.533918 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-1a89d173-da24-4107-a681-131fe224377f tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:11.535090 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-1a89d173-da24-4107-a681-131fe224377f tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:11.537721 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-1a89d173-da24-4107-a681-131fe224377f tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:11.538421 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-1a89d173-da24-4107-a681-131fe224377f tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:11.625279 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-8b00291f-4f6d-4b0f-8c05-51b19e31f051 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:11.626598 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-8b00291f-4f6d-4b0f-8c05-51b19e31f051 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] [instance: c4277200-c999-4c53-85de-b2a8b120cd6d] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:11.645196 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-8b00291f-4f6d-4b0f-8c05-51b19e31f051 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:11.651975 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-8b00291f-4f6d-4b0f-8c05-51b19e31f051 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:11.653072 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-8b00291f-4f6d-4b0f-8c05-51b19e31f051 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:11.657425 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-8b00291f-4f6d-4b0f-8c05-51b19e31f051 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:12.151944 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-1a89d173-da24-4107-a681-131fe224377f tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:12.160049 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-1a89d173-da24-4107-a681-131fe224377f tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1407f346-2c64-41d0-b983-268e60273230" status: 200 len: 1520 microversion: 2.1 time: 0.650461 Jun 16 19:01:12.169905 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 108/216] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:11 2022] GET /compute/v2.1/servers/1407f346-2c64-41d0-b983-268e60273230 => generated 1520 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:12.295222 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-8b00291f-4f6d-4b0f-8c05-51b19e31f051 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27db09b804fa426a83f103cf5dd116a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629634dc3dc54893b68cb9c9dc08505d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:12.309204 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-8b00291f-4f6d-4b0f-8c05-51b19e31f051 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] 10.222.0.70 "GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d" status: 200 len: 1259 microversion: 2.1 time: 0.692506 Jun 16 19:01:12.315523 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 109/217] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:11 2022] GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d => generated 1259 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:13.177304 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-74f041c7-5e2a-4ef7-8841-3b1868122d14 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:13.180110 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-74f041c7-5e2a-4ef7-8841-3b1868122d14 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1407f346-2c64-41d0-b983-268e60273230] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:13.199264 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-74f041c7-5e2a-4ef7-8841-3b1868122d14 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:13.200940 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-74f041c7-5e2a-4ef7-8841-3b1868122d14 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:13.203675 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-74f041c7-5e2a-4ef7-8841-3b1868122d14 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:13.206431 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-74f041c7-5e2a-4ef7-8841-3b1868122d14 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:13.330012 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-b57b4b6c-8ba9-43b7-a57e-f6c6eaa226fc tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:13.331316 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-b57b4b6c-8ba9-43b7-a57e-f6c6eaa226fc tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] [instance: c4277200-c999-4c53-85de-b2a8b120cd6d] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:13.342789 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-b57b4b6c-8ba9-43b7-a57e-f6c6eaa226fc tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:13.349630 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-b57b4b6c-8ba9-43b7-a57e-f6c6eaa226fc tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:13.351989 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-b57b4b6c-8ba9-43b7-a57e-f6c6eaa226fc tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:13.354886 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-b57b4b6c-8ba9-43b7-a57e-f6c6eaa226fc tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:13.441693 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:01:13.772607 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-b57b4b6c-8ba9-43b7-a57e-f6c6eaa226fc tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27db09b804fa426a83f103cf5dd116a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629634dc3dc54893b68cb9c9dc08505d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:13.801351 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-b57b4b6c-8ba9-43b7-a57e-f6c6eaa226fc tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] 10.222.0.70 "GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d" status: 200 len: 1259 microversion: 2.1 time: 0.469276 Jun 16 19:01:13.806403 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 110/218] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:13 2022] GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d => generated 1259 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:14.410776 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-74f041c7-5e2a-4ef7-8841-3b1868122d14 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:14.426483 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-74f041c7-5e2a-4ef7-8841-3b1868122d14 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1407f346-2c64-41d0-b983-268e60273230" status: 200 len: 1520 microversion: 2.1 time: 1.249304 Jun 16 19:01:14.428185 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 109/219] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:13 2022] GET /compute/v2.1/servers/1407f346-2c64-41d0-b983-268e60273230 => generated 1520 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:14.553079 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [req-fecabc7c-fd71-4883-bad0-c0c9d634f2f7 req-e238131b-093b-4568-955d-ea4359ddbd03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4277200-c999-4c53-85de-b2a8b120cd6d", "tag": "52aa00b3-538a-446a-8118-2c3fa72e640d"}]} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:01:14.578402 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-fecabc7c-fd71-4883-bad0-c0c9d634f2f7 req-e238131b-093b-4568-955d-ea4359ddbd03 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:14.582768 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-fecabc7c-fd71-4883-bad0-c0c9d634f2f7 req-e238131b-093b-4568-955d-ea4359ddbd03 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:14.610100 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.compute.server_external_events [req-fecabc7c-fd71-4883-bad0-c0c9d634f2f7 req-e238131b-093b-4568-955d-ea4359ddbd03 service nova] Creating event network-changed:52aa00b3-538a-446a-8118-2c3fa72e640d for instance c4277200-c999-4c53-85de-b2a8b120cd6d on hv-cinder-84617 Jun 16 19:01:14.616200 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [req-fecabc7c-fd71-4883-bad0-c0c9d634f2f7 req-e238131b-093b-4568-955d-ea4359ddbd03 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067348 Jun 16 19:01:14.617761 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 111/220] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:01:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:01:14.821986 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-669042e9-4bb8-49a5-898e-261b2f62bc29 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:14.823223 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-669042e9-4bb8-49a5-898e-261b2f62bc29 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] [instance: c4277200-c999-4c53-85de-b2a8b120cd6d] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:14.845343 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-669042e9-4bb8-49a5-898e-261b2f62bc29 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:14.848917 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-669042e9-4bb8-49a5-898e-261b2f62bc29 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:14.856074 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-669042e9-4bb8-49a5-898e-261b2f62bc29 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:14.864921 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-669042e9-4bb8-49a5-898e-261b2f62bc29 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:15.449909 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-9795c310-b33d-474a-8e84-dc5d73b6f829 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:15.451229 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-9795c310-b33d-474a-8e84-dc5d73b6f829 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1407f346-2c64-41d0-b983-268e60273230] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:15.468619 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-9795c310-b33d-474a-8e84-dc5d73b6f829 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:15.469084 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-9795c310-b33d-474a-8e84-dc5d73b6f829 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:15.469911 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-9795c310-b33d-474a-8e84-dc5d73b6f829 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:15.470393 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-9795c310-b33d-474a-8e84-dc5d73b6f829 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:15.611951 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-669042e9-4bb8-49a5-898e-261b2f62bc29 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27db09b804fa426a83f103cf5dd116a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629634dc3dc54893b68cb9c9dc08505d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:15.629221 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-669042e9-4bb8-49a5-898e-261b2f62bc29 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] 10.222.0.70 "GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d" status: 200 len: 1259 microversion: 2.1 time: 0.812396 Jun 16 19:01:15.631638 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 110/221] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:14 2022] GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d => generated 1259 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:16.428845 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-9795c310-b33d-474a-8e84-dc5d73b6f829 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:16.503005 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-9795c310-b33d-474a-8e84-dc5d73b6f829 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1407f346-2c64-41d0-b983-268e60273230" status: 200 len: 1520 microversion: 2.1 time: 1.055821 Jun 16 19:01:16.506093 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 112/222] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:15 2022] GET /compute/v2.1/servers/1407f346-2c64-41d0-b983-268e60273230 => generated 1520 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:16.648613 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-abd10eee-830c-404e-841a-ff82ce9d9da8 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:16.649231 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-abd10eee-830c-404e-841a-ff82ce9d9da8 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] [instance: c4277200-c999-4c53-85de-b2a8b120cd6d] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:16.673135 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-abd10eee-830c-404e-841a-ff82ce9d9da8 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:16.673916 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-abd10eee-830c-404e-841a-ff82ce9d9da8 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:16.674854 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-abd10eee-830c-404e-841a-ff82ce9d9da8 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:16.675295 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-abd10eee-830c-404e-841a-ff82ce9d9da8 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:16.810494 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_cell0:SELECT=2 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:01:16.847375 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_cell0:SELECT=6 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:01:17.222906 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-abd10eee-830c-404e-841a-ff82ce9d9da8 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27db09b804fa426a83f103cf5dd116a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629634dc3dc54893b68cb9c9dc08505d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:17.239648 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-abd10eee-830c-404e-841a-ff82ce9d9da8 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] 10.222.0.70 "GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d" status: 200 len: 1259 microversion: 2.1 time: 0.595382 Jun 16 19:01:17.245623 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 111/223] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:16 2022] GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d => generated 1259 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:17.536964 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-9362c128-2deb-4e5d-a6ad-69460b278a1e tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:17.538436 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-9362c128-2deb-4e5d-a6ad-69460b278a1e tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1407f346-2c64-41d0-b983-268e60273230] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:17.555204 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-9362c128-2deb-4e5d-a6ad-69460b278a1e tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:17.556165 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-9362c128-2deb-4e5d-a6ad-69460b278a1e tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:17.557286 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-9362c128-2deb-4e5d-a6ad-69460b278a1e tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:17.559645 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-9362c128-2deb-4e5d-a6ad-69460b278a1e tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:18.058628 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_cell0:SELECT=2 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:01:18.094195 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-9362c128-2deb-4e5d-a6ad-69460b278a1e tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:18.105987 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-9362c128-2deb-4e5d-a6ad-69460b278a1e tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1407f346-2c64-41d0-b983-268e60273230" status: 200 len: 1500 microversion: 2.1 time: 0.573768 Jun 16 19:01:18.109971 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 113/224] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:17 2022] GET /compute/v2.1/servers/1407f346-2c64-41d0-b983-268e60273230 => generated 1500 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:18.128614 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-9053abca-25ba-41b0-b079-09a8d7daa391 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d8a1caa6-0b39-4ede-a369-f2b60eb3f411"}} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:01:18.133496 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-9053abca-25ba-41b0-b079-09a8d7daa391 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1407f346-2c64-41d0-b983-268e60273230] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:18.185517 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-9053abca-25ba-41b0-b079-09a8d7daa391 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:18.186741 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-9053abca-25ba-41b0-b079-09a8d7daa391 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:18.194094 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-9053abca-25ba-41b0-b079-09a8d7daa391 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:18.197027 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-9053abca-25ba-41b0-b079-09a8d7daa391 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:18.264537 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-3864d7ae-96b7-4b01-a0a2-773f01fa2a12 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:18.265725 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-3864d7ae-96b7-4b01-a0a2-773f01fa2a12 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] [instance: c4277200-c999-4c53-85de-b2a8b120cd6d] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:18.286473 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-3864d7ae-96b7-4b01-a0a2-773f01fa2a12 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:18.289184 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-3864d7ae-96b7-4b01-a0a2-773f01fa2a12 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:18.290223 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-3864d7ae-96b7-4b01-a0a2-773f01fa2a12 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:18.291189 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-3864d7ae-96b7-4b01-a0a2-773f01fa2a12 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:18.302849 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.wsgi [None req-9053abca-25ba-41b0-b079-09a8d7daa391 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] HTTP exception thrown: Cannot 'attach_volume' instance 1407f346-2c64-41d0-b983-268e60273230 while it is in vm_state rescued Jun 16 19:01:18.306512 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-9053abca-25ba-41b0-b079-09a8d7daa391 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Request method failure captured: Jun 16 19:01:18.306512 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: request: POST /compute/v2.1/servers/1407f346-2c64-41d0-b983-268e60273230/os-volume_attachments HTTP/1.1 Jun 16 19:01:18.306512 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Accept: application/json Jun 16 19:01:18.306512 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Accept-Encoding: identity Jun 16 19:01:18.306512 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Connection: close Jun 16 19:01:18.306512 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Content-Length: 74 Jun 16 19:01:18.306512 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Content-Type: application/json Jun 16 19:01:18.306512 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Host: 10.222.0.70 Jun 16 19:01:18.306512 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Openstack-System-Scope: None Jun 16 19:01:18.306512 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: User-Agent: python-urllib3/1.26.9 Jun 16 19:01:18.306512 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Auth-Token: gAAAAABiq32MWlG48BHx8XuuslNdJYyJSrfQU2dcwoyRLL7bw-NKnsaA5lLVdqK2IJiUTQDMxha5Lp11Vgbk2btE0OekI4NBXVXjOTkuuqI_1FxxjoULRHMKHfsoz-Idvd1wKyC2h9kbUWif20GzMiR8FTKv464r3WLs3Okv1rHkW7SJoX6YE7s Jun 16 19:01:18.306512 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Domain-Id: None Jun 16 19:01:18.306512 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Domain-Name: None Jun 16 19:01:18.306512 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Identity-Status: Confirmed Jun 16 19:01:18.306512 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Is-Admin-Project: True Jun 16 19:01:18.306512 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Domain-Id: default Jun 16 19:01:18.306512 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Domain-Name: Default Jun 16 19:01:18.306512 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Id: 83b304be7bd84301b898bb50f4ac7ae4 Jun 16 19:01:18.306512 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-548083212 Jun 16 19:01:18.306512 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Role: member,reader Jun 16 19:01:18.306512 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Roles: member,reader Jun 16 19:01:18.308027 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/83b304be7bd84301b898bb50f4ac7ae4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_83b304be7bd84301b898bb50f4ac7ae4", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/83b304be7bd84301b898bb50f4ac7ae4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/83b304be7bd84301b898bb50f4ac7ae4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 16 19:01:18.308027 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant: tempest-ServerRescueNegativeTestJSON-548083212 Jun 16 19:01:18.308027 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant-Id: 83b304be7bd84301b898bb50f4ac7ae4 Jun 16 19:01:18.308027 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-548083212 Jun 16 19:01:18.308027 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User: tempest-ServerRescueNegativeTestJSON-548083212-project Jun 16 19:01:18.308027 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Domain-Id: default Jun 16 19:01:18.308027 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Domain-Name: Default Jun 16 19:01:18.308027 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Id: 7f703f74c7ff43a291f54103e164ccdf Jun 16 19:01:18.308027 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Name: tempest-ServerRescueNegativeTestJSON-548083212-project Jun 16 19:01:18.308027 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Jun 16 19:01:18.308027 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: {"volumeAttachment": {"volumeId": "d8a1caa6-0b39-4ede-a369-f2b60eb3f411"}} Jun 16 19:01:18.308027 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: method: > Jun 16 19:01:18.308920 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: exception: Cannot 'attach_volume' instance 1407f346-2c64-41d0-b983-268e60273230 while it is in vm_state rescued Jun 16 19:01:18.308920 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: action_args: {'server_id': '1407f346-2c64-41d0-b983-268e60273230', 'body': {'volumeAttachment': {'volumeId': 'd8a1caa6-0b39-4ede-a369-f2b60eb3f411'}}} Jun 16 19:01:18.308920 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:01:18.308920 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:01:18.308920 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 16 19:01:18.308920 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 16 19:01:18.308920 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 19:01:18.308920 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 19:01:18.308920 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 16 19:01:18.308920 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 16 19:01:18.308920 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1407f346-2c64-41d0-b983-268e60273230 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 16 19:01:18.308920 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:01:18.308920 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:01:18.308920 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:01:18.308920 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:01:18.308920 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:01:18.308920 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:01:18.308920 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:01:18.308920 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:01:18.314530 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:01:18.314530 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:01:18.314530 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 19:01:18.314530 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 19:01:18.314530 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 19:01:18.314530 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 19:01:18.314530 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 19:01:18.314530 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 19:01:18.314530 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 16 19:01:18.314530 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 16 19:01:18.314530 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 16 19:01:18.314530 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 16 19:01:18.314530 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 1407f346-2c64-41d0-b983-268e60273230 while it is in vm_state rescued Jun 16 19:01:18.314530 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:01:18.314530 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:01:18.314530 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:01:18.314530 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:01:18.314530 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:01:18.314530 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:01:18.316155 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:01:18.316155 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:01:18.316155 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 1407f346-2c64-41d0-b983-268e60273230 while it is in vm_state rescued Jun 16 19:01:18.316155 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:01:18.343009 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-9053abca-25ba-41b0-b079-09a8d7daa391 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Returning 409 to user: Cannot 'attach_volume' instance 1407f346-2c64-41d0-b983-268e60273230 while it is in vm_state rescued {{(pid=117850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:01:18.362680 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-9053abca-25ba-41b0-b079-09a8d7daa391 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "POST /compute/v2.1/servers/1407f346-2c64-41d0-b983-268e60273230/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.220855 Jun 16 19:01:18.363378 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 112/225] 10.222.0.70 () {60 vars in 1322 bytes} [Thu Jun 16 19:01:18 2022] POST /compute/v2.1/servers/1407f346-2c64-41d0-b983-268e60273230/os-volume_attachments => generated 152 bytes in 242 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 16 19:01:18.372760 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-fe09864c-3d57-403f-894a-5b146b4859ac tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:01:18.373380 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-fe09864c-3d57-403f-894a-5b146b4859ac tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1407f346-2c64-41d0-b983-268e60273230] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:18.393810 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-fe09864c-3d57-403f-894a-5b146b4859ac tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:18.399249 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-fe09864c-3d57-403f-894a-5b146b4859ac tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:18.401459 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-fe09864c-3d57-403f-894a-5b146b4859ac tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:18.404822 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-fe09864c-3d57-403f-894a-5b146b4859ac tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:18.560591 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-fe09864c-3d57-403f-894a-5b146b4859ac tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "POST /compute/v2.1/servers/1407f346-2c64-41d0-b983-268e60273230/action" status: 202 len: 0 microversion: 2.1 time: 0.191912 Jun 16 19:01:18.562559 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 113/226] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Jun 16 19:01:18 2022] POST /compute/v2.1/servers/1407f346-2c64-41d0-b983-268e60273230/action => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 19:01:18.576680 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-78d90708-0c1d-4ff4-b7ac-8767be049b3a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:18.578597 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-78d90708-0c1d-4ff4-b7ac-8767be049b3a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1407f346-2c64-41d0-b983-268e60273230] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:18.607578 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-78d90708-0c1d-4ff4-b7ac-8767be049b3a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:18.608007 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-78d90708-0c1d-4ff4-b7ac-8767be049b3a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:18.611212 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-78d90708-0c1d-4ff4-b7ac-8767be049b3a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:18.612995 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-78d90708-0c1d-4ff4-b7ac-8767be049b3a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:18.665009 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:01:18.723549 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-3864d7ae-96b7-4b01-a0a2-773f01fa2a12 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27db09b804fa426a83f103cf5dd116a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629634dc3dc54893b68cb9c9dc08505d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:18.731933 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-3864d7ae-96b7-4b01-a0a2-773f01fa2a12 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] 10.222.0.70 "GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d" status: 200 len: 1259 microversion: 2.1 time: 0.477356 Jun 16 19:01:18.732520 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 114/227] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:18 2022] GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d => generated 1259 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:18.971264 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-78d90708-0c1d-4ff4-b7ac-8767be049b3a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:18.993534 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-78d90708-0c1d-4ff4-b7ac-8767be049b3a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1407f346-2c64-41d0-b983-268e60273230" status: 200 len: 1508 microversion: 2.1 time: 0.425105 Jun 16 19:01:19.005334 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 114/228] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:18 2022] GET /compute/v2.1/servers/1407f346-2c64-41d0-b983-268e60273230 => generated 1508 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:19.754444 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-9d0ad680-f428-4e35-bc03-46951f56df45 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:19.755892 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-9d0ad680-f428-4e35-bc03-46951f56df45 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] [instance: c4277200-c999-4c53-85de-b2a8b120cd6d] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:19.773886 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-9d0ad680-f428-4e35-bc03-46951f56df45 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:19.774354 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-9d0ad680-f428-4e35-bc03-46951f56df45 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:19.775184 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-9d0ad680-f428-4e35-bc03-46951f56df45 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:19.775629 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-9d0ad680-f428-4e35-bc03-46951f56df45 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:20.016663 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-b52700ad-70d3-4345-8701-ad3cc8213e97 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:20.017448 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-b52700ad-70d3-4345-8701-ad3cc8213e97 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1407f346-2c64-41d0-b983-268e60273230] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:20.038539 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b52700ad-70d3-4345-8701-ad3cc8213e97 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:20.039977 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b52700ad-70d3-4345-8701-ad3cc8213e97 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:20.042716 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b52700ad-70d3-4345-8701-ad3cc8213e97 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:20.044121 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b52700ad-70d3-4345-8701-ad3cc8213e97 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:20.119789 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-9d0ad680-f428-4e35-bc03-46951f56df45 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27db09b804fa426a83f103cf5dd116a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629634dc3dc54893b68cb9c9dc08505d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:20.132081 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-9d0ad680-f428-4e35-bc03-46951f56df45 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] 10.222.0.70 "GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d" status: 200 len: 1259 microversion: 2.1 time: 0.387240 Jun 16 19:01:20.139266 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 115/229] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:19 2022] GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d => generated 1259 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:20.628092 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-b52700ad-70d3-4345-8701-ad3cc8213e97 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:20.640255 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-b52700ad-70d3-4345-8701-ad3cc8213e97 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1407f346-2c64-41d0-b983-268e60273230" status: 200 len: 1508 microversion: 2.1 time: 0.631784 Jun 16 19:01:20.641753 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 115/230] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:20 2022] GET /compute/v2.1/servers/1407f346-2c64-41d0-b983-268e60273230 => generated 1508 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:01:21.155736 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-1ac3fc75-ed7f-45a8-bc4c-4a707ecf91a7 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:21.156372 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-1ac3fc75-ed7f-45a8-bc4c-4a707ecf91a7 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] [instance: c4277200-c999-4c53-85de-b2a8b120cd6d] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:21.163649 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-1ac3fc75-ed7f-45a8-bc4c-4a707ecf91a7 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:21.164819 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-1ac3fc75-ed7f-45a8-bc4c-4a707ecf91a7 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:21.166265 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-1ac3fc75-ed7f-45a8-bc4c-4a707ecf91a7 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:21.166877 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-1ac3fc75-ed7f-45a8-bc4c-4a707ecf91a7 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:21.660517 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-92c8e89b-be24-4690-9e2b-363544983e3d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:21.661388 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-92c8e89b-be24-4690-9e2b-363544983e3d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1407f346-2c64-41d0-b983-268e60273230] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:21.676804 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-92c8e89b-be24-4690-9e2b-363544983e3d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:21.677258 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-92c8e89b-be24-4690-9e2b-363544983e3d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:21.678040 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-92c8e89b-be24-4690-9e2b-363544983e3d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:21.678477 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-92c8e89b-be24-4690-9e2b-363544983e3d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:21.920360 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-1ac3fc75-ed7f-45a8-bc4c-4a707ecf91a7 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27db09b804fa426a83f103cf5dd116a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629634dc3dc54893b68cb9c9dc08505d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:21.939693 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-1ac3fc75-ed7f-45a8-bc4c-4a707ecf91a7 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] 10.222.0.70 "GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d" status: 200 len: 1259 microversion: 2.1 time: 0.790113 Jun 16 19:01:21.943615 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 116/231] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:21 2022] GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d => generated 1259 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:22.049082 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-92c8e89b-be24-4690-9e2b-363544983e3d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:22.064231 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-92c8e89b-be24-4690-9e2b-363544983e3d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1407f346-2c64-41d0-b983-268e60273230" status: 200 len: 1508 microversion: 2.1 time: 0.408334 Jun 16 19:01:22.076756 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 116/232] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:21 2022] GET /compute/v2.1/servers/1407f346-2c64-41d0-b983-268e60273230 => generated 1508 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:01:22.967526 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-4f1a52ab-370c-45ab-b8b1-8a0a6b5614aa tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:22.968902 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-4f1a52ab-370c-45ab-b8b1-8a0a6b5614aa tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] [instance: c4277200-c999-4c53-85de-b2a8b120cd6d] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:22.986225 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_api:SELECT=52 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:01:22.990531 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-4f1a52ab-370c-45ab-b8b1-8a0a6b5614aa tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:22.992145 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-4f1a52ab-370c-45ab-b8b1-8a0a6b5614aa tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:22.993636 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-4f1a52ab-370c-45ab-b8b1-8a0a6b5614aa tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:22.995103 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-4f1a52ab-370c-45ab-b8b1-8a0a6b5614aa tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:23.087495 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-fe114e32-7848-4db8-8221-d8fe377bc982 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:23.088106 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-fe114e32-7848-4db8-8221-d8fe377bc982 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1407f346-2c64-41d0-b983-268e60273230] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:23.107334 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-fe114e32-7848-4db8-8221-d8fe377bc982 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:23.108067 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-fe114e32-7848-4db8-8221-d8fe377bc982 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:23.109006 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-fe114e32-7848-4db8-8221-d8fe377bc982 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:23.109580 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-fe114e32-7848-4db8-8221-d8fe377bc982 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:23.359387 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-fe114e32-7848-4db8-8221-d8fe377bc982 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:23.368811 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-fe114e32-7848-4db8-8221-d8fe377bc982 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1407f346-2c64-41d0-b983-268e60273230" status: 200 len: 1508 microversion: 2.1 time: 0.283815 Jun 16 19:01:23.382542 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 117/233] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:23 2022] GET /compute/v2.1/servers/1407f346-2c64-41d0-b983-268e60273230 => generated 1508 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:23.454274 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-4f1a52ab-370c-45ab-b8b1-8a0a6b5614aa tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27db09b804fa426a83f103cf5dd116a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629634dc3dc54893b68cb9c9dc08505d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:23.474795 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-4f1a52ab-370c-45ab-b8b1-8a0a6b5614aa tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] 10.222.0.70 "GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d" status: 200 len: 1259 microversion: 2.1 time: 0.521669 Jun 16 19:01:23.475383 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 117/234] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:22 2022] GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d => generated 1259 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:24.387997 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-0c6e634c-9c43-46c3-9f2d-d944456a4e0d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:24.388824 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-0c6e634c-9c43-46c3-9f2d-d944456a4e0d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1407f346-2c64-41d0-b983-268e60273230] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:24.426412 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0c6e634c-9c43-46c3-9f2d-d944456a4e0d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:24.426824 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0c6e634c-9c43-46c3-9f2d-d944456a4e0d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:24.427628 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0c6e634c-9c43-46c3-9f2d-d944456a4e0d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:24.428067 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0c6e634c-9c43-46c3-9f2d-d944456a4e0d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:24.498775 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-7034e984-bc1c-470c-9644-e15bd1563b15 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:24.499772 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-7034e984-bc1c-470c-9644-e15bd1563b15 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] [instance: c4277200-c999-4c53-85de-b2a8b120cd6d] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:24.523116 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-7034e984-bc1c-470c-9644-e15bd1563b15 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:24.523753 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-7034e984-bc1c-470c-9644-e15bd1563b15 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:24.524577 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-7034e984-bc1c-470c-9644-e15bd1563b15 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:24.525014 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-7034e984-bc1c-470c-9644-e15bd1563b15 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:24.769073 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-0c6e634c-9c43-46c3-9f2d-d944456a4e0d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:24.786902 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-0c6e634c-9c43-46c3-9f2d-d944456a4e0d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1407f346-2c64-41d0-b983-268e60273230" status: 200 len: 1508 microversion: 2.1 time: 0.401997 Jun 16 19:01:24.789828 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 118/235] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:24 2022] GET /compute/v2.1/servers/1407f346-2c64-41d0-b983-268e60273230 => generated 1508 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:24.999563 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-7034e984-bc1c-470c-9644-e15bd1563b15 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27db09b804fa426a83f103cf5dd116a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629634dc3dc54893b68cb9c9dc08505d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:25.011629 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-7034e984-bc1c-470c-9644-e15bd1563b15 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] 10.222.0.70 "GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d" status: 200 len: 1259 microversion: 2.1 time: 0.522989 Jun 16 19:01:25.020022 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 118/236] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:24 2022] GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d => generated 1259 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:25.809197 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-c69d834d-2d2f-4c4b-ae1c-6ad9d55ac29b tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:25.812138 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-c69d834d-2d2f-4c4b-ae1c-6ad9d55ac29b tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1407f346-2c64-41d0-b983-268e60273230] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:25.838453 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:01:25.865775 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-c69d834d-2d2f-4c4b-ae1c-6ad9d55ac29b tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:25.870219 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-c69d834d-2d2f-4c4b-ae1c-6ad9d55ac29b tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:25.874456 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-c69d834d-2d2f-4c4b-ae1c-6ad9d55ac29b tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:25.875280 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-c69d834d-2d2f-4c4b-ae1c-6ad9d55ac29b tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:26.072164 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-eaf9f670-4c42-491a-96de-81768847b0c3 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:26.072925 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-eaf9f670-4c42-491a-96de-81768847b0c3 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] [instance: c4277200-c999-4c53-85de-b2a8b120cd6d] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:26.110408 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-eaf9f670-4c42-491a-96de-81768847b0c3 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:26.111356 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-eaf9f670-4c42-491a-96de-81768847b0c3 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:26.115864 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-eaf9f670-4c42-491a-96de-81768847b0c3 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:26.116702 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-eaf9f670-4c42-491a-96de-81768847b0c3 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:26.295659 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-c69d834d-2d2f-4c4b-ae1c-6ad9d55ac29b tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:26.308458 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-c69d834d-2d2f-4c4b-ae1c-6ad9d55ac29b tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1407f346-2c64-41d0-b983-268e60273230" status: 200 len: 1514 microversion: 2.1 time: 0.503659 Jun 16 19:01:26.310101 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 119/237] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:25 2022] GET /compute/v2.1/servers/1407f346-2c64-41d0-b983-268e60273230 => generated 1514 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:26.457019 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-eaf9f670-4c42-491a-96de-81768847b0c3 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27db09b804fa426a83f103cf5dd116a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629634dc3dc54893b68cb9c9dc08505d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:26.470089 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-eaf9f670-4c42-491a-96de-81768847b0c3 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] 10.222.0.70 "GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d" status: 200 len: 1259 microversion: 2.1 time: 0.432517 Jun 16 19:01:26.472799 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 119/238] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:26 2022] GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d => generated 1259 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:27.491180 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-31ea9ec8-e2e4-4744-b448-91c7c40cec50 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:27.493324 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-31ea9ec8-e2e4-4744-b448-91c7c40cec50 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] [instance: c4277200-c999-4c53-85de-b2a8b120cd6d] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:27.510131 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-31ea9ec8-e2e4-4744-b448-91c7c40cec50 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:27.510598 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-31ea9ec8-e2e4-4744-b448-91c7c40cec50 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:27.516615 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-31ea9ec8-e2e4-4744-b448-91c7c40cec50 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:27.518165 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-31ea9ec8-e2e4-4744-b448-91c7c40cec50 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:27.945457 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-31ea9ec8-e2e4-4744-b448-91c7c40cec50 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27db09b804fa426a83f103cf5dd116a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629634dc3dc54893b68cb9c9dc08505d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:27.957108 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-31ea9ec8-e2e4-4744-b448-91c7c40cec50 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] 10.222.0.70 "GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d" status: 200 len: 1259 microversion: 2.1 time: 0.472478 Jun 16 19:01:27.958801 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 120/239] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:27 2022] GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d => generated 1259 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:28.004731 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [req-5edf75c4-4758-461c-b9c3-556fa2b33ad1 req-2b983675-d125-47db-8211-30f609855d61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4277200-c999-4c53-85de-b2a8b120cd6d", "name": "network-vif-plugged", "status": "completed", "tag": "52aa00b3-538a-446a-8118-2c3fa72e640d"}]} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:01:28.041823 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-5edf75c4-4758-461c-b9c3-556fa2b33ad1 req-2b983675-d125-47db-8211-30f609855d61 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:28.042272 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-5edf75c4-4758-461c-b9c3-556fa2b33ad1 req-2b983675-d125-47db-8211-30f609855d61 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:28.058197 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.compute.server_external_events [req-5edf75c4-4758-461c-b9c3-556fa2b33ad1 req-2b983675-d125-47db-8211-30f609855d61 service nova] Creating event network-vif-plugged:52aa00b3-538a-446a-8118-2c3fa72e640d for instance c4277200-c999-4c53-85de-b2a8b120cd6d on hv-cinder-84617 Jun 16 19:01:28.080661 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-e67c5d86-e82b-4148-8a86-f8a7fad97741 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Action: 'create', calling method: .version_select at 0x7f12e68c2c10>, body: {"keypair": {"name": "tempest-keypair-1699936319", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNigO1KrzbLzB+R6gpU9PGmZG+53fQdG3z/Bs/4Y57EoBdpS9CMdLF9buMfM4spov+0luZSoS0O3fEBsS4DJDlx5fwUsyd/xX4e2Vp5kDWFp/HHZgx/ZX/d3HvxqzcgZOA=="}} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:01:28.082439 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [req-5edf75c4-4758-461c-b9c3-556fa2b33ad1 req-2b983675-d125-47db-8211-30f609855d61 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084079 Jun 16 19:01:28.083742 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 120/240] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:01:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:01:28.154904 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.quota [None req-e67c5d86-e82b-4148-8a86-f8a7fad97741 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Getting quotas for project 83b304be7bd84301b898bb50f4ac7ae4. Resources: {'key_pairs'} {{(pid=117850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:01:28.167654 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.quota [None req-e67c5d86-e82b-4148-8a86-f8a7fad97741 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Getting quotas for user 7f703f74c7ff43a291f54103e164ccdf and project 83b304be7bd84301b898bb50f4ac7ae4. Resources: {'key_pairs'} {{(pid=117850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:01:28.278754 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-e67c5d86-e82b-4148-8a86-f8a7fad97741 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.201918 Jun 16 19:01:28.279990 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 121/241] 10.222.0.70 () {60 vars in 1158 bytes} [Thu Jun 16 19:01:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:01:28.978172 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-5d853371-e34a-4b36-9d3f-4604bda126ef tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:28.979438 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-5d853371-e34a-4b36-9d3f-4604bda126ef tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] [instance: c4277200-c999-4c53-85de-b2a8b120cd6d] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:28.997536 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-5d853371-e34a-4b36-9d3f-4604bda126ef tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:29.005700 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-5d853371-e34a-4b36-9d3f-4604bda126ef tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:29.011644 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-5d853371-e34a-4b36-9d3f-4604bda126ef tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:29.012990 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-5d853371-e34a-4b36-9d3f-4604bda126ef tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:29.436596 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-5d853371-e34a-4b36-9d3f-4604bda126ef tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27db09b804fa426a83f103cf5dd116a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629634dc3dc54893b68cb9c9dc08505d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:29.448005 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-5d853371-e34a-4b36-9d3f-4604bda126ef tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] 10.222.0.70 "GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d" status: 200 len: 1259 microversion: 2.1 time: 0.474294 Jun 16 19:01:29.453874 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 121/242] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:28 2022] GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d => generated 1259 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:30.476966 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-492c09eb-5301-4dc9-9e9e-c9196370b9ca tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:30.478253 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-492c09eb-5301-4dc9-9e9e-c9196370b9ca tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] [instance: c4277200-c999-4c53-85de-b2a8b120cd6d] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:30.500316 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-492c09eb-5301-4dc9-9e9e-c9196370b9ca tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:30.506623 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-492c09eb-5301-4dc9-9e9e-c9196370b9ca tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:30.507742 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-492c09eb-5301-4dc9-9e9e-c9196370b9ca tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:30.512806 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-492c09eb-5301-4dc9-9e9e-c9196370b9ca tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:31.164509 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-492c09eb-5301-4dc9-9e9e-c9196370b9ca tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27db09b804fa426a83f103cf5dd116a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629634dc3dc54893b68cb9c9dc08505d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:31.179711 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-492c09eb-5301-4dc9-9e9e-c9196370b9ca tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] 10.222.0.70 "GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d" status: 200 len: 1259 microversion: 2.1 time: 0.707631 Jun 16 19:01:31.183847 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 122/243] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:30 2022] GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d => generated 1259 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:32.197903 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-581a640b-2e98-4825-8229-2ee2d875ad22 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:32.199170 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-581a640b-2e98-4825-8229-2ee2d875ad22 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] [instance: c4277200-c999-4c53-85de-b2a8b120cd6d] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:32.250086 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-581a640b-2e98-4825-8229-2ee2d875ad22 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:32.250557 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-581a640b-2e98-4825-8229-2ee2d875ad22 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:32.251375 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-581a640b-2e98-4825-8229-2ee2d875ad22 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:32.251977 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-581a640b-2e98-4825-8229-2ee2d875ad22 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:32.706352 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-3fb9c052-70a3-4a0e-af59-a94889b0ca21 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1222698860", "imageRef": "1d993e69-7f01-4fe0-ba52-0eae2fa43ddf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f41d193c-78d1-4108-9995-cf5c5eb8fc37"}], "security_groups": [{"name": "tempest-securitygroup--390828307"}], "key_name": "tempest-keypair-1699936319", "user_data": "}} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:01:33.348030 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-581a640b-2e98-4825-8229-2ee2d875ad22 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27db09b804fa426a83f103cf5dd116a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629634dc3dc54893b68cb9c9dc08505d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:33.361415 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-581a640b-2e98-4825-8229-2ee2d875ad22 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] 10.222.0.70 "GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d" status: 200 len: 1443 microversion: 2.1 time: 1.165393 Jun 16 19:01:33.364077 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 122/244] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:32 2022] GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d => generated 1443 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:33.384349 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-00e06869-3125-4eca-9230-f440375bf20c tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:33.388178 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-00e06869-3125-4eca-9230-f440375bf20c tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] [instance: c4277200-c999-4c53-85de-b2a8b120cd6d] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:33.402078 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-00e06869-3125-4eca-9230-f440375bf20c tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:33.405483 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-00e06869-3125-4eca-9230-f440375bf20c tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:33.408824 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-00e06869-3125-4eca-9230-f440375bf20c tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:33.410187 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-00e06869-3125-4eca-9230-f440375bf20c tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:34.048829 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-00e06869-3125-4eca-9230-f440375bf20c tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27db09b804fa426a83f103cf5dd116a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629634dc3dc54893b68cb9c9dc08505d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:34.061415 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-00e06869-3125-4eca-9230-f440375bf20c tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] 10.222.0.70 "GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d" status: 200 len: 1443 microversion: 2.1 time: 0.680831 Jun 16 19:01:34.062781 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 123/245] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:33 2022] GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d => generated 1443 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:34.069907 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-4834d867-b2e5-464c-9f78-84a844396a9c tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:34.070679 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-4834d867-b2e5-464c-9f78-84a844396a9c tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:34.079990 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-4834d867-b2e5-464c-9f78-84a844396a9c tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:34.080697 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-4834d867-b2e5-464c-9f78-84a844396a9c tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:34.082021 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-4834d867-b2e5-464c-9f78-84a844396a9c tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:34.083460 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-4834d867-b2e5-464c-9f78-84a844396a9c tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:34.114614 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-4834d867-b2e5-464c-9f78-84a844396a9c tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4/ips" status: 200 len: 152 microversion: 2.20 time: 0.050353 Jun 16 19:01:34.134703 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 124/246] 10.222.0.70 () {60 vars in 1288 bytes} [Thu Jun 16 19:01:34 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4/ips => generated 152 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 19:01:34.654436 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-f442c33d-9b5f-474f-9020-d470c5175f1e tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:34.678390 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-f442c33d-9b5f-474f-9020-d470c5175f1e tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:34.710143 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f442c33d-9b5f-474f-9020-d470c5175f1e tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:34.713800 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f442c33d-9b5f-474f-9020-d470c5175f1e tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:34.722301 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f442c33d-9b5f-474f-9020-d470c5175f1e tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:34.724264 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f442c33d-9b5f-474f-9020-d470c5175f1e tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:34.879491 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-f442c33d-9b5f-474f-9020-d470c5175f1e tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee/ips" status: 200 len: 145 microversion: 2.1 time: 0.239679 Jun 16 19:01:34.886411 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 125/247] 10.222.0.70 () {58 vars in 1247 bytes} [Thu Jun 16 19:01:34 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee/ips => generated 145 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:01:35.291853 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-a065fa36-a054-4a15-8694-26e98d3440f6 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Action: 'create', calling method: .version_select at 0x7f12e5fa8d30>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2106478105", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYpv3Wpalb8mQo+7f2VfTLW9TFLVLqr49GDG5w/wPyucl2SqU8vW6WBg5a2uAEDI2ORPd0cicvaXqnD5SktTbw+ku8ZZSUvx/a4ZGTxgrCxuhbJdptFAcKJwetipUYgDQ=="}} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:01:35.342037 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.quota [None req-a065fa36-a054-4a15-8694-26e98d3440f6 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Getting quotas for project 741ee13164894b49be1a0fc6c1385a8e. Resources: {'key_pairs'} {{(pid=117852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:01:35.356831 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.quota [None req-a065fa36-a054-4a15-8694-26e98d3440f6 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Getting quotas for user 047e841cefdd4975947b2c154412953b and project 741ee13164894b49be1a0fc6c1385a8e. Resources: {'key_pairs'} {{(pid=117852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:01:35.420513 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-a065fa36-a054-4a15-8694-26e98d3440f6 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.132517 Jun 16 19:01:35.421746 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 126/248] 10.222.0.70 () {60 vars in 1158 bytes} [Thu Jun 16 19:01:35 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:01:35.476641 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.network.neutron [None req-3fb9c052-70a3-4a0e-af59-a94889b0ca21 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] validate_networks() for [('f41d193c-78d1-4108-9995-cf5c5eb8fc37', None, None, None, None, None)] {{(pid=117850) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:01:35.599049 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-443aff44-5739-4f61-a1b7-d14189bf0ff0 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1055567863", "imageRef": "b982aa02-54e0-4658-a4ef-c2959a6a079b", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2106478105", "networks": [{"uuid": "50d202ad-9b01-4d3d-baaf-92d33ea12e70"}]}} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:01:35.708084 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.network.neutron [None req-443aff44-5739-4f61-a1b7-d14189bf0ff0 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] validate_networks() for [('50d202ad-9b01-4d3d-baaf-92d33ea12e70', None, None, None, None, None)] {{(pid=117852) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:01:36.795868 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-3fb9c052-70a3-4a0e-af59-a94889b0ca21 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Flavor limits 0:0:0 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:01:36.796295 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-3fb9c052-70a3-4a0e-af59-a94889b0ca21 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Image limits 0:0:0 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:01:36.796791 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-3fb9c052-70a3-4a0e-af59-a94889b0ca21 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Flavor pref 0:0:0 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:01:36.797232 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-3fb9c052-70a3-4a0e-af59-a94889b0ca21 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Image pref 0:0:0 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:01:36.797676 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-3fb9c052-70a3-4a0e-af59-a94889b0ca21 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:01:36.813224 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-3fb9c052-70a3-4a0e-af59-a94889b0ca21 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:36.814506 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-3fb9c052-70a3-4a0e-af59-a94889b0ca21 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:36.816209 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-3fb9c052-70a3-4a0e-af59-a94889b0ca21 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:36.816964 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-3fb9c052-70a3-4a0e-af59-a94889b0ca21 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:36.853458 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.quota [None req-3fb9c052-70a3-4a0e-af59-a94889b0ca21 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Getting quotas for project 83b304be7bd84301b898bb50f4ac7ae4. Resources: {'cores', 'ram', 'instances'} {{(pid=117850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:01:36.865225 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.quota [None req-3fb9c052-70a3-4a0e-af59-a94889b0ca21 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Getting quotas for user 7f703f74c7ff43a291f54103e164ccdf and project 83b304be7bd84301b898bb50f4ac7ae4. Resources: {'cores', 'ram', 'instances'} {{(pid=117850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:01:36.888469 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-3fb9c052-70a3-4a0e-af59-a94889b0ca21 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Going to run 1 instances... {{(pid=117850) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:01:36.894381 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-3fb9c052-70a3-4a0e-af59-a94889b0ca21 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1d993e69-7f01-4fe0-ba52-0eae2fa43ddf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:01:36.894559 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.virt.hardware [None req-443aff44-5739-4f61-a1b7-d14189bf0ff0 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Flavor limits 0:0:0 {{(pid=117852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:01:36.895049 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.virt.hardware [None req-443aff44-5739-4f61-a1b7-d14189bf0ff0 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Image limits 0:0:0 {{(pid=117852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:01:36.895748 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.virt.hardware [None req-443aff44-5739-4f61-a1b7-d14189bf0ff0 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Flavor pref 0:0:0 {{(pid=117852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:01:36.896683 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.virt.hardware [None req-443aff44-5739-4f61-a1b7-d14189bf0ff0 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Image pref 0:0:0 {{(pid=117852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:01:36.897319 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.virt.hardware [None req-443aff44-5739-4f61-a1b7-d14189bf0ff0 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:01:36.921262 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-443aff44-5739-4f61-a1b7-d14189bf0ff0 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:36.921897 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-443aff44-5739-4f61-a1b7-d14189bf0ff0 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:36.926108 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-443aff44-5739-4f61-a1b7-d14189bf0ff0 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:36.926915 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-443aff44-5739-4f61-a1b7-d14189bf0ff0 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:36.986638 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.quota [None req-443aff44-5739-4f61-a1b7-d14189bf0ff0 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Getting quotas for project 741ee13164894b49be1a0fc6c1385a8e. Resources: {'cores', 'ram', 'instances'} {{(pid=117852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:01:36.997337 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.quota [None req-443aff44-5739-4f61-a1b7-d14189bf0ff0 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Getting quotas for user 047e841cefdd4975947b2c154412953b and project 741ee13164894b49be1a0fc6c1385a8e. Resources: {'cores', 'ram', 'instances'} {{(pid=117852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:01:37.022198 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-443aff44-5739-4f61-a1b7-d14189bf0ff0 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Going to run 1 instances... {{(pid=117852) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:01:37.025292 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-443aff44-5739-4f61-a1b7-d14189bf0ff0 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] [instance: edce90bf-b3d6-49de-a45f-9b65e1759b51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b982aa02-54e0-4658-a4ef-c2959a6a079b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117852) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:01:37.084793 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-3fb9c052-70a3-4a0e-af59-a94889b0ca21 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 4.391189 Jun 16 19:01:37.090928 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 123/249] 10.222.0.70 () {60 vars in 1146 bytes} [Thu Jun 16 19:01:32 2022] POST /compute/v2.1/servers => generated 408 bytes in 4398 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:01:37.103862 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-b974d4ec-4940-4cbf-9ee8-6a28286e5d29 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:01:37.104472 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-b974d4ec-4940-4cbf-9ee8-6a28286e5d29 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:37.128232 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b974d4ec-4940-4cbf-9ee8-6a28286e5d29 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:37.129105 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b974d4ec-4940-4cbf-9ee8-6a28286e5d29 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:37.132646 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b974d4ec-4940-4cbf-9ee8-6a28286e5d29 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:37.137465 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b974d4ec-4940-4cbf-9ee8-6a28286e5d29 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:37.146662 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-443aff44-5739-4f61-a1b7-d14189bf0ff0 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.552422 Jun 16 19:01:37.148714 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 127/250] 10.222.0.70 () {60 vars in 1146 bytes} [Thu Jun 16 19:01:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1555 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 19:01:37.155425 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-d1d846e5-a38b-4e13-965e-fe0fdbe93d5a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:37.156406 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-d1d846e5-a38b-4e13-965e-fe0fdbe93d5a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:37.216953 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.objects.instance [None req-b974d4ec-4940-4cbf-9ee8-6a28286e5d29 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lazy-loading 'flavor' on Instance uuid 1c077a29-12e0-48af-a8b6-43d0b5a79bf4 {{(pid=117850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:01:37.452013 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-d1d846e5-a38b-4e13-965e-fe0fdbe93d5a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:37.461723 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-d1d846e5-a38b-4e13-965e-fe0fdbe93d5a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f" status: 200 len: 1246 microversion: 2.1 time: 0.310362 Jun 16 19:01:37.477717 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 128/251] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:37 2022] GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f => generated 1246 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:37.501788 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-f64cdbb3-5f75-4834-8ef7-1d0f7d41d271 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:37.504144 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-f64cdbb3-5f75-4834-8ef7-1d0f7d41d271 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] [instance: edce90bf-b3d6-49de-a45f-9b65e1759b51] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:37.767011 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-f64cdbb3-5f75-4834-8ef7-1d0f7d41d271 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047e841cefdd4975947b2c154412953b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741ee13164894b49be1a0fc6c1385a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:37.779129 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-f64cdbb3-5f75-4834-8ef7-1d0f7d41d271 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] 10.222.0.70 "GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51" status: 200 len: 1259 microversion: 2.1 time: 0.297497 Jun 16 19:01:37.779904 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 129/252] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:37 2022] GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51 => generated 1259 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:37.804467 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-34b561df-8c1a-4e4e-9bd0-6053d3a53b8b tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cbdcf7d3-51cc-44bd-92f8-90a9d9895c57"}} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:01:37.807173 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-34b561df-8c1a-4e4e-9bd0-6053d3a53b8b tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:37.837028 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-34b561df-8c1a-4e4e-9bd0-6053d3a53b8b tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:37.839056 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-34b561df-8c1a-4e4e-9bd0-6053d3a53b8b tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:37.842034 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-34b561df-8c1a-4e4e-9bd0-6053d3a53b8b tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:37.843987 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-34b561df-8c1a-4e4e-9bd0-6053d3a53b8b tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:37.940350 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-b974d4ec-4940-4cbf-9ee8-6a28286e5d29 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "POST /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4/action" status: 202 len: 0 microversion: 2.20 time: 0.847285 Jun 16 19:01:37.941683 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 124/253] 10.222.0.70 () {62 vars in 1318 bytes} [Thu Jun 16 19:01:37 2022] POST /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4/action => generated 0 bytes in 850 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:01:37.962213 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-102299c8-8eaf-4f43-966d-3b47e2cf7618 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:37.963404 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-102299c8-8eaf-4f43-966d-3b47e2cf7618 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:37.996363 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-102299c8-8eaf-4f43-966d-3b47e2cf7618 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:37.997288 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-102299c8-8eaf-4f43-966d-3b47e2cf7618 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:37.998277 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-102299c8-8eaf-4f43-966d-3b47e2cf7618 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:37.999160 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-102299c8-8eaf-4f43-966d-3b47e2cf7618 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:38.598603 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-34b561df-8c1a-4e4e-9bd0-6053d3a53b8b tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "POST /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.803581 Jun 16 19:01:38.604493 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 130/254] 10.222.0.70 () {60 vars in 1322 bytes} [Thu Jun 16 19:01:37 2022] POST /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee/os-volume_attachments => generated 194 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:01:38.637215 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-6e45c18f-7673-41ef-8a7a-5a0f09cbe62e tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:38.643900 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-6e45c18f-7673-41ef-8a7a-5a0f09cbe62e tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:38.675596 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-6e45c18f-7673-41ef-8a7a-5a0f09cbe62e tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:38.676394 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-6e45c18f-7673-41ef-8a7a-5a0f09cbe62e tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:38.677396 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-6e45c18f-7673-41ef-8a7a-5a0f09cbe62e tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:38.678017 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-6e45c18f-7673-41ef-8a7a-5a0f09cbe62e tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:38.702149 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-102299c8-8eaf-4f43-966d-3b47e2cf7618 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:38.729222 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-102299c8-8eaf-4f43-966d-3b47e2cf7618 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:38.735402 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-102299c8-8eaf-4f43-966d-3b47e2cf7618 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:38.751678 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-102299c8-8eaf-4f43-966d-3b47e2cf7618 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1723 microversion: 2.20 time: 0.803165 Jun 16 19:01:38.769266 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 125/255] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:01:37 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1723 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:01:38.791304 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:01:38.798854 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-d9161703-197e-4441-9a77-8e8aa9ab4bf2 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:38.800273 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-d9161703-197e-4441-9a77-8e8aa9ab4bf2 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] [instance: edce90bf-b3d6-49de-a45f-9b65e1759b51] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:38.835572 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d9161703-197e-4441-9a77-8e8aa9ab4bf2 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:38.840096 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d9161703-197e-4441-9a77-8e8aa9ab4bf2 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:38.841967 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d9161703-197e-4441-9a77-8e8aa9ab4bf2 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:38.847408 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d9161703-197e-4441-9a77-8e8aa9ab4bf2 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:39.066086 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-d9161703-197e-4441-9a77-8e8aa9ab4bf2 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047e841cefdd4975947b2c154412953b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741ee13164894b49be1a0fc6c1385a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:39.081238 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-d9161703-197e-4441-9a77-8e8aa9ab4bf2 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] 10.222.0.70 "GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51" status: 200 len: 1311 microversion: 2.1 time: 0.288461 Jun 16 19:01:39.085103 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 126/256] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:38 2022] GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51 => generated 1311 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:39.282558 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-6e45c18f-7673-41ef-8a7a-5a0f09cbe62e tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:39.295892 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-6e45c18f-7673-41ef-8a7a-5a0f09cbe62e tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f" status: 200 len: 1242 microversion: 2.1 time: 0.685586 Jun 16 19:01:39.296525 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 131/257] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:38 2022] GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f => generated 1242 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:39.557056 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [req-fa9f15f7-9d4c-4168-88d0-85500780aacb req-a791673d-3ce6-4c73-9f14-f8b79005634f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4277200-c999-4c53-85de-b2a8b120cd6d", "tag": "52aa00b3-538a-446a-8118-2c3fa72e640d"}]} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:01:39.571233 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-fa9f15f7-9d4c-4168-88d0-85500780aacb req-a791673d-3ce6-4c73-9f14-f8b79005634f service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:39.572614 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-fa9f15f7-9d4c-4168-88d0-85500780aacb req-a791673d-3ce6-4c73-9f14-f8b79005634f service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:39.609090 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.compute.server_external_events [req-fa9f15f7-9d4c-4168-88d0-85500780aacb req-a791673d-3ce6-4c73-9f14-f8b79005634f service nova] Creating event network-changed:52aa00b3-538a-446a-8118-2c3fa72e640d for instance c4277200-c999-4c53-85de-b2a8b120cd6d on hv-cinder-84617 Jun 16 19:01:39.636794 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [req-fa9f15f7-9d4c-4168-88d0-85500780aacb req-a791673d-3ce6-4c73-9f14-f8b79005634f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083827 Jun 16 19:01:39.637767 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 127/258] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:01:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:01:39.780411 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-0284d25b-5174-4178-a49b-f7896eae36c7 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:39.791416 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-0284d25b-5174-4178-a49b-f7896eae36c7 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:39.824093 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0284d25b-5174-4178-a49b-f7896eae36c7 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:39.828158 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0284d25b-5174-4178-a49b-f7896eae36c7 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:39.829152 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0284d25b-5174-4178-a49b-f7896eae36c7 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:39.829726 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0284d25b-5174-4178-a49b-f7896eae36c7 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:40.145175 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-4bfde62b-d287-4d46-bcd0-36fb36fe4af8 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Action: 'create', calling method: .version_select at 0x7f12e5f9edc0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-550046181", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPnojcNJeeE/mUy5UkCkLZHcatRlow3XbZUILtg8+HEP3G3iuHWeqd0eldQXMk5Ytsgz/ZAiVA0t0daj5fHysGZtuQg4I+3THzynsXLgj6WQWt3V9uRXCysGaWNvV2upaQ=="}} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:01:40.187339 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.quota [None req-4bfde62b-d287-4d46-bcd0-36fb36fe4af8 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Getting quotas for project 0e52189be8d24c9894ef05cc7acf367c. Resources: {'key_pairs'} {{(pid=117852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:01:40.201186 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.quota [None req-4bfde62b-d287-4d46-bcd0-36fb36fe4af8 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Getting quotas for user 922a970a740444a2959c6aa1d0921ee7 and project 0e52189be8d24c9894ef05cc7acf367c. Resources: {'key_pairs'} {{(pid=117852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:01:40.257596 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-0284d25b-5174-4178-a49b-f7896eae36c7 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:40.259457 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-4bfde62b-d287-4d46-bcd0-36fb36fe4af8 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.573316 Jun 16 19:01:40.263638 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 132/259] 10.222.0.70 () {60 vars in 1158 bytes} [Thu Jun 16 19:01:39 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:01:40.279264 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-d3c01844-cc42-46aa-8878-46b1861b66c3 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:40.280239 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-d3c01844-cc42-46aa-8878-46b1861b66c3 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] [instance: edce90bf-b3d6-49de-a45f-9b65e1759b51] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:40.280712 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-0284d25b-5174-4178-a49b-f7896eae36c7 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:40.285070 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-0284d25b-5174-4178-a49b-f7896eae36c7 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:40.286363 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-0284d25b-5174-4178-a49b-f7896eae36c7 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1723 microversion: 2.20 time: 0.513411 Jun 16 19:01:40.287016 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 128/260] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:01:39 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1723 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:01:40.313582 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d3c01844-cc42-46aa-8878-46b1861b66c3 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:40.314619 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d3c01844-cc42-46aa-8878-46b1861b66c3 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:40.315873 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-5a603f20-5deb-478c-9a86-9ed8adec2ae7 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:40.316522 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-5a603f20-5deb-478c-9a86-9ed8adec2ae7 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:40.317563 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d3c01844-cc42-46aa-8878-46b1861b66c3 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:40.318117 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d3c01844-cc42-46aa-8878-46b1861b66c3 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:40.323232 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-5a603f20-5deb-478c-9a86-9ed8adec2ae7 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:40.323623 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-5a603f20-5deb-478c-9a86-9ed8adec2ae7 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:40.325037 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-5a603f20-5deb-478c-9a86-9ed8adec2ae7 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:40.325165 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-5a603f20-5deb-478c-9a86-9ed8adec2ae7 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:40.462605 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-5a603f20-5deb-478c-9a86-9ed8adec2ae7 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:40.488421 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-5a603f20-5deb-478c-9a86-9ed8adec2ae7 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f" status: 200 len: 1316 microversion: 2.1 time: 0.175536 Jun 16 19:01:40.490394 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 129/261] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:40 2022] GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f => generated 1316 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:01:40.536237 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-d3c01844-cc42-46aa-8878-46b1861b66c3 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047e841cefdd4975947b2c154412953b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741ee13164894b49be1a0fc6c1385a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:40.554894 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-d3c01844-cc42-46aa-8878-46b1861b66c3 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] 10.222.0.70 "GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51" status: 200 len: 1317 microversion: 2.1 time: 0.289825 Jun 16 19:01:40.557124 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 133/262] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:40 2022] GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51 => generated 1317 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:41.307810 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-c5229531-143b-4639-b0cf-07d70d63cc30 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:41.308508 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-c5229531-143b-4639-b0cf-07d70d63cc30 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:41.318099 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-c5229531-143b-4639-b0cf-07d70d63cc30 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:41.318541 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-c5229531-143b-4639-b0cf-07d70d63cc30 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:41.330013 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-c5229531-143b-4639-b0cf-07d70d63cc30 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:41.330475 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-c5229531-143b-4639-b0cf-07d70d63cc30 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:41.507348 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-367813fe-f54e-4d25-81e7-897453bc35fe tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:41.508692 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-367813fe-f54e-4d25-81e7-897453bc35fe tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:41.522006 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-367813fe-f54e-4d25-81e7-897453bc35fe tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:41.526192 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-367813fe-f54e-4d25-81e7-897453bc35fe tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:41.539188 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-367813fe-f54e-4d25-81e7-897453bc35fe tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:41.543241 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-367813fe-f54e-4d25-81e7-897453bc35fe tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:41.895609 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-367813fe-f54e-4d25-81e7-897453bc35fe tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:41.922691 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-367813fe-f54e-4d25-81e7-897453bc35fe tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f" status: 200 len: 1304 microversion: 2.1 time: 0.418710 Jun 16 19:01:41.927402 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 134/263] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:41 2022] GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f => generated 1304 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:41.951878 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-70a38931-2893-4b22-b5f8-5ba5cf04dc59 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:41.961733 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-70a38931-2893-4b22-b5f8-5ba5cf04dc59 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] [instance: edce90bf-b3d6-49de-a45f-9b65e1759b51] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:41.979123 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-70a38931-2893-4b22-b5f8-5ba5cf04dc59 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:41.980577 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-70a38931-2893-4b22-b5f8-5ba5cf04dc59 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:41.985330 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-70a38931-2893-4b22-b5f8-5ba5cf04dc59 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:41.993579 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-70a38931-2893-4b22-b5f8-5ba5cf04dc59 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:42.155592 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-70a38931-2893-4b22-b5f8-5ba5cf04dc59 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047e841cefdd4975947b2c154412953b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741ee13164894b49be1a0fc6c1385a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:42.164348 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-70a38931-2893-4b22-b5f8-5ba5cf04dc59 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] 10.222.0.70 "GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51" status: 200 len: 1317 microversion: 2.1 time: 0.233287 Jun 16 19:01:42.168466 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 135/264] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:41 2022] GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51 => generated 1317 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:42.190990 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-c5229531-143b-4639-b0cf-07d70d63cc30 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:42.200783 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-c5229531-143b-4639-b0cf-07d70d63cc30 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:42.213098 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-c5229531-143b-4639-b0cf-07d70d63cc30 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:42.214909 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-c5229531-143b-4639-b0cf-07d70d63cc30 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1723 microversion: 2.20 time: 0.912715 Jun 16 19:01:42.217771 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 130/265] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:01:41 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1723 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:01:42.944504 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-062c5b95-8526-4302-a5f4-d3271052f595 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:42.947774 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-062c5b95-8526-4302-a5f4-d3271052f595 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:42.961005 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-062c5b95-8526-4302-a5f4-d3271052f595 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:42.985566 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-062c5b95-8526-4302-a5f4-d3271052f595 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:42.986483 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-062c5b95-8526-4302-a5f4-d3271052f595 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:42.987139 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-062c5b95-8526-4302-a5f4-d3271052f595 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:43.190687 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-d2234641-ad05-4bc8-b25f-88a2d9fee3ba tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:43.191301 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-d2234641-ad05-4bc8-b25f-88a2d9fee3ba tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] [instance: edce90bf-b3d6-49de-a45f-9b65e1759b51] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:43.208698 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d2234641-ad05-4bc8-b25f-88a2d9fee3ba tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:43.216155 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d2234641-ad05-4bc8-b25f-88a2d9fee3ba tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:43.217337 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d2234641-ad05-4bc8-b25f-88a2d9fee3ba tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:43.218210 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d2234641-ad05-4bc8-b25f-88a2d9fee3ba tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:43.264072 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:01:43.415114 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-062c5b95-8526-4302-a5f4-d3271052f595 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:43.426801 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-062c5b95-8526-4302-a5f4-d3271052f595 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f" status: 200 len: 1371 microversion: 2.1 time: 0.486460 Jun 16 19:01:43.428552 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 136/266] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:42 2022] GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f => generated 1371 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:01:43.435014 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-bd524968-45b4-452f-aca0-1d31f9e8bfda tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:43.437772 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-bd524968-45b4-452f-aca0-1d31f9e8bfda tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:43.456914 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-bd524968-45b4-452f-aca0-1d31f9e8bfda tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:43.461990 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-bd524968-45b4-452f-aca0-1d31f9e8bfda tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:43.463766 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-bd524968-45b4-452f-aca0-1d31f9e8bfda tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:43.468046 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-bd524968-45b4-452f-aca0-1d31f9e8bfda tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:43.660180 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-d2234641-ad05-4bc8-b25f-88a2d9fee3ba tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047e841cefdd4975947b2c154412953b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741ee13164894b49be1a0fc6c1385a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:43.676195 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-d2234641-ad05-4bc8-b25f-88a2d9fee3ba tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] 10.222.0.70 "GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51" status: 200 len: 1359 microversion: 2.1 time: 0.494759 Jun 16 19:01:43.677215 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 131/267] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:43 2022] GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51 => generated 1359 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:43.832442 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-bd524968-45b4-452f-aca0-1d31f9e8bfda tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:43.863439 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-bd524968-45b4-452f-aca0-1d31f9e8bfda tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:43.871680 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-bd524968-45b4-452f-aca0-1d31f9e8bfda tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:43.887315 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-bd524968-45b4-452f-aca0-1d31f9e8bfda tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1723 microversion: 2.20 time: 0.442291 Jun 16 19:01:43.887592 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 137/268] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:01:43 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1723 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:01:44.446374 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-7456d42e-0d1a-4716-a614-641cbdbc7bb9 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:44.447111 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-7456d42e-0d1a-4716-a614-641cbdbc7bb9 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:44.483374 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-7456d42e-0d1a-4716-a614-641cbdbc7bb9 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:44.486049 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-7456d42e-0d1a-4716-a614-641cbdbc7bb9 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:44.493657 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-7456d42e-0d1a-4716-a614-641cbdbc7bb9 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:44.494194 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-7456d42e-0d1a-4716-a614-641cbdbc7bb9 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:44.693043 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-b5e3b862-39a1-47b2-9e11-d5264917e0a9 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:44.694378 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-b5e3b862-39a1-47b2-9e11-d5264917e0a9 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] [instance: edce90bf-b3d6-49de-a45f-9b65e1759b51] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:44.710892 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-b5e3b862-39a1-47b2-9e11-d5264917e0a9 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:44.715328 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-b5e3b862-39a1-47b2-9e11-d5264917e0a9 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:44.716242 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-b5e3b862-39a1-47b2-9e11-d5264917e0a9 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:44.716692 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-b5e3b862-39a1-47b2-9e11-d5264917e0a9 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:44.961018 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-7456d42e-0d1a-4716-a614-641cbdbc7bb9 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:44.975645 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-7456d42e-0d1a-4716-a614-641cbdbc7bb9 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f" status: 200 len: 1371 microversion: 2.1 time: 0.531832 Jun 16 19:01:44.977419 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 132/269] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:44 2022] GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f => generated 1371 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:45.003910 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-77183275-ab25-4307-a3f7-1caa0d51c4a1 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:45.006828 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-77183275-ab25-4307-a3f7-1caa0d51c4a1 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:45.028332 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-77183275-ab25-4307-a3f7-1caa0d51c4a1 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:45.039721 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-77183275-ab25-4307-a3f7-1caa0d51c4a1 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:45.042281 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-77183275-ab25-4307-a3f7-1caa0d51c4a1 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:45.043528 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-77183275-ab25-4307-a3f7-1caa0d51c4a1 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:45.263600 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-b5e3b862-39a1-47b2-9e11-d5264917e0a9 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047e841cefdd4975947b2c154412953b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741ee13164894b49be1a0fc6c1385a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:45.293861 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-b5e3b862-39a1-47b2-9e11-d5264917e0a9 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] 10.222.0.70 "GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51" status: 200 len: 1359 microversion: 2.1 time: 0.603216 Jun 16 19:01:45.295173 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 138/270] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:44 2022] GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51 => generated 1359 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:45.617980 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-77183275-ab25-4307-a3f7-1caa0d51c4a1 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:45.645777 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-77183275-ab25-4307-a3f7-1caa0d51c4a1 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:45.649850 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-77183275-ab25-4307-a3f7-1caa0d51c4a1 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:45.654245 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-77183275-ab25-4307-a3f7-1caa0d51c4a1 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1723 microversion: 2.20 time: 0.671925 Jun 16 19:01:45.655941 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 133/271] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:01:44 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1723 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:01:45.997426 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-88a4b48f-e4fe-4adc-80ea-ad931b625f08 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:45.998925 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-88a4b48f-e4fe-4adc-80ea-ad931b625f08 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:46.025925 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-88a4b48f-e4fe-4adc-80ea-ad931b625f08 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:46.028724 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-88a4b48f-e4fe-4adc-80ea-ad931b625f08 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:46.032922 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-88a4b48f-e4fe-4adc-80ea-ad931b625f08 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:46.033922 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-88a4b48f-e4fe-4adc-80ea-ad931b625f08 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:46.312642 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-b4e2ce97-b5ee-4362-801c-ff1e4fa71808 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:46.313592 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-b4e2ce97-b5ee-4362-801c-ff1e4fa71808 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] [instance: edce90bf-b3d6-49de-a45f-9b65e1759b51] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:46.330438 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b4e2ce97-b5ee-4362-801c-ff1e4fa71808 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:46.331006 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b4e2ce97-b5ee-4362-801c-ff1e4fa71808 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:46.332206 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b4e2ce97-b5ee-4362-801c-ff1e4fa71808 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:46.332915 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b4e2ce97-b5ee-4362-801c-ff1e4fa71808 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:46.336884 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-88a4b48f-e4fe-4adc-80ea-ad931b625f08 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:46.352805 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-88a4b48f-e4fe-4adc-80ea-ad931b625f08 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f" status: 200 len: 1371 microversion: 2.1 time: 0.361872 Jun 16 19:01:46.353453 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 139/272] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:45 2022] GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f => generated 1371 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:01:46.681155 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-cb78306f-be9b-46a4-9991-803976380a95 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:46.681397 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-b4e2ce97-b5ee-4362-801c-ff1e4fa71808 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047e841cefdd4975947b2c154412953b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741ee13164894b49be1a0fc6c1385a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:46.682252 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-cb78306f-be9b-46a4-9991-803976380a95 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:46.697104 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-cb78306f-be9b-46a4-9991-803976380a95 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:46.697556 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-cb78306f-be9b-46a4-9991-803976380a95 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:46.699144 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-cb78306f-be9b-46a4-9991-803976380a95 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:46.699756 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-cb78306f-be9b-46a4-9991-803976380a95 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:46.707127 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-b4e2ce97-b5ee-4362-801c-ff1e4fa71808 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] 10.222.0.70 "GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51" status: 200 len: 1359 microversion: 2.1 time: 0.398059 Jun 16 19:01:46.708767 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 134/273] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:46 2022] GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51 => generated 1359 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:01:46.964739 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-cb78306f-be9b-46a4-9991-803976380a95 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:46.975221 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-cb78306f-be9b-46a4-9991-803976380a95 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:46.976979 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-cb78306f-be9b-46a4-9991-803976380a95 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:46.986143 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-cb78306f-be9b-46a4-9991-803976380a95 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1723 microversion: 2.20 time: 0.309246 Jun 16 19:01:46.988221 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 140/274] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:01:46 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1723 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:01:47.367657 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_cell0:SELECT=2 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:01:47.368293 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_cell0:SELECT=10 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:01:47.374788 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-b7647c25-34db-432a-ab83-721ef36cbc1d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:47.375655 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-b7647c25-34db-432a-ab83-721ef36cbc1d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:47.396592 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b7647c25-34db-432a-ab83-721ef36cbc1d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:47.414681 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b7647c25-34db-432a-ab83-721ef36cbc1d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:47.415818 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b7647c25-34db-432a-ab83-721ef36cbc1d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:47.416424 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b7647c25-34db-432a-ab83-721ef36cbc1d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:47.728096 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-b735ef42-8410-4aeb-8a49-652d80d7b5ab tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:47.729376 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-b735ef42-8410-4aeb-8a49-652d80d7b5ab tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] [instance: edce90bf-b3d6-49de-a45f-9b65e1759b51] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:47.732038 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_cell0:SELECT=2 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:01:47.732293 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-b7647c25-34db-432a-ab83-721ef36cbc1d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:47.740940 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-b735ef42-8410-4aeb-8a49-652d80d7b5ab tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:47.741736 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-b735ef42-8410-4aeb-8a49-652d80d7b5ab tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:47.742832 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-b735ef42-8410-4aeb-8a49-652d80d7b5ab tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:47.743010 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-b7647c25-34db-432a-ab83-721ef36cbc1d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f" status: 200 len: 1371 microversion: 2.1 time: 0.375806 Jun 16 19:01:47.744816 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 135/275] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:47 2022] GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f => generated 1371 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:47.748826 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-b735ef42-8410-4aeb-8a49-652d80d7b5ab tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:47.968229 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-b735ef42-8410-4aeb-8a49-652d80d7b5ab tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047e841cefdd4975947b2c154412953b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741ee13164894b49be1a0fc6c1385a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:47.975761 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-b735ef42-8410-4aeb-8a49-652d80d7b5ab tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] 10.222.0.70 "GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51" status: 200 len: 1359 microversion: 2.1 time: 0.254279 Jun 16 19:01:47.976734 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 141/276] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:47 2022] GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51 => generated 1359 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:48.008174 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-5e9bb2a5-182e-433e-b650-d66a67b35d73 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:48.009078 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-5e9bb2a5-182e-433e-b650-d66a67b35d73 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:48.018886 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-5e9bb2a5-182e-433e-b650-d66a67b35d73 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:48.020020 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-5e9bb2a5-182e-433e-b650-d66a67b35d73 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:48.021134 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-5e9bb2a5-182e-433e-b650-d66a67b35d73 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:48.021803 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-5e9bb2a5-182e-433e-b650-d66a67b35d73 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:48.238537 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-5e9bb2a5-182e-433e-b650-d66a67b35d73 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:48.249684 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-5e9bb2a5-182e-433e-b650-d66a67b35d73 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:48.251548 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-5e9bb2a5-182e-433e-b650-d66a67b35d73 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:48.252818 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-5e9bb2a5-182e-433e-b650-d66a67b35d73 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1723 microversion: 2.20 time: 0.250128 Jun 16 19:01:48.253877 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 136/277] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:01:48 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1723 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:01:48.761799 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-3b717531-bce5-45e7-b6d1-250c66c1115e tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:48.763067 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-3b717531-bce5-45e7-b6d1-250c66c1115e tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:48.781362 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-3b717531-bce5-45e7-b6d1-250c66c1115e tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:48.781825 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-3b717531-bce5-45e7-b6d1-250c66c1115e tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:48.782635 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-3b717531-bce5-45e7-b6d1-250c66c1115e tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:48.795323 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-3b717531-bce5-45e7-b6d1-250c66c1115e tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:48.977860 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-3b717531-bce5-45e7-b6d1-250c66c1115e tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:48.985963 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-3b717531-bce5-45e7-b6d1-250c66c1115e tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f" status: 200 len: 1371 microversion: 2.1 time: 0.228474 Jun 16 19:01:48.994376 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 142/278] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:48 2022] GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f => generated 1371 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:49.001267 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-76fae6d1-1507-49a5-a993-e479e58008ea tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:49.002222 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-76fae6d1-1507-49a5-a993-e479e58008ea tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] [instance: edce90bf-b3d6-49de-a45f-9b65e1759b51] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:49.009832 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-76fae6d1-1507-49a5-a993-e479e58008ea tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:49.010278 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-76fae6d1-1507-49a5-a993-e479e58008ea tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:49.011600 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-76fae6d1-1507-49a5-a993-e479e58008ea tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:49.012207 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-76fae6d1-1507-49a5-a993-e479e58008ea tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:49.212921 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-76fae6d1-1507-49a5-a993-e479e58008ea tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047e841cefdd4975947b2c154412953b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741ee13164894b49be1a0fc6c1385a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:49.228811 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-76fae6d1-1507-49a5-a993-e479e58008ea tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] 10.222.0.70 "GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51" status: 200 len: 1359 microversion: 2.1 time: 0.232360 Jun 16 19:01:49.230049 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 137/279] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:48 2022] GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51 => generated 1359 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:49.272706 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-7b8109cd-8935-4e50-aaa7-293738f4351c tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:49.273337 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-7b8109cd-8935-4e50-aaa7-293738f4351c tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:49.280837 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-7b8109cd-8935-4e50-aaa7-293738f4351c tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:49.281424 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-7b8109cd-8935-4e50-aaa7-293738f4351c tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:49.282256 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-7b8109cd-8935-4e50-aaa7-293738f4351c tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:49.282817 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-7b8109cd-8935-4e50-aaa7-293738f4351c tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:49.462714 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-7b8109cd-8935-4e50-aaa7-293738f4351c tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:49.472291 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-7b8109cd-8935-4e50-aaa7-293738f4351c tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:49.474134 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-7b8109cd-8935-4e50-aaa7-293738f4351c tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:49.476293 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-7b8109cd-8935-4e50-aaa7-293738f4351c tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1723 microversion: 2.20 time: 0.207780 Jun 16 19:01:49.486786 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 143/280] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:01:49 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1723 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:01:50.003261 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-9bd6e322-ff23-4b2a-928e-b38d68e77a53 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:50.003963 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-9bd6e322-ff23-4b2a-928e-b38d68e77a53 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:50.010766 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-9bd6e322-ff23-4b2a-928e-b38d68e77a53 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:50.011730 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-9bd6e322-ff23-4b2a-928e-b38d68e77a53 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:50.012726 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-9bd6e322-ff23-4b2a-928e-b38d68e77a53 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:50.017754 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-9bd6e322-ff23-4b2a-928e-b38d68e77a53 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:50.208249 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-9bd6e322-ff23-4b2a-928e-b38d68e77a53 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:50.218876 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-9bd6e322-ff23-4b2a-928e-b38d68e77a53 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f" status: 200 len: 1371 microversion: 2.1 time: 0.219461 Jun 16 19:01:50.219536 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 138/281] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:49 2022] GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f => generated 1371 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:01:50.247401 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-5f0aaa50-b323-42c5-97fc-10291c5c4d45 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:50.248020 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-5f0aaa50-b323-42c5-97fc-10291c5c4d45 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] [instance: edce90bf-b3d6-49de-a45f-9b65e1759b51] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:50.250543 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_cell0:SELECT=18 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:01:50.260749 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-5f0aaa50-b323-42c5-97fc-10291c5c4d45 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:50.262022 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-5f0aaa50-b323-42c5-97fc-10291c5c4d45 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:50.263003 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-5f0aaa50-b323-42c5-97fc-10291c5c4d45 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:50.263679 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-5f0aaa50-b323-42c5-97fc-10291c5c4d45 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:50.434066 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-5f0aaa50-b323-42c5-97fc-10291c5c4d45 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047e841cefdd4975947b2c154412953b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741ee13164894b49be1a0fc6c1385a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:50.442240 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-5f0aaa50-b323-42c5-97fc-10291c5c4d45 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] 10.222.0.70 "GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51" status: 200 len: 1359 microversion: 2.1 time: 0.198518 Jun 16 19:01:50.461119 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 144/282] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:50 2022] GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51 => generated 1359 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:50.497079 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-48d45e66-e90f-43d5-9e09-acb1ce561b58 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:50.497701 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-48d45e66-e90f-43d5-9e09-acb1ce561b58 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:50.503764 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-48d45e66-e90f-43d5-9e09-acb1ce561b58 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:50.504214 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-48d45e66-e90f-43d5-9e09-acb1ce561b58 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:50.504986 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-48d45e66-e90f-43d5-9e09-acb1ce561b58 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:50.505421 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-48d45e66-e90f-43d5-9e09-acb1ce561b58 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:50.699718 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-48d45e66-e90f-43d5-9e09-acb1ce561b58 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:50.712764 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-48d45e66-e90f-43d5-9e09-acb1ce561b58 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:50.714969 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-48d45e66-e90f-43d5-9e09-acb1ce561b58 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:50.717427 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-48d45e66-e90f-43d5-9e09-acb1ce561b58 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1723 microversion: 2.20 time: 0.224908 Jun 16 19:01:50.718614 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 139/283] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:01:50 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1723 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:01:51.236941 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-5de68e55-2c45-4d9c-96e6-fc8b40802c90 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:51.237640 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-5de68e55-2c45-4d9c-96e6-fc8b40802c90 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:51.248165 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-5de68e55-2c45-4d9c-96e6-fc8b40802c90 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:51.248933 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-5de68e55-2c45-4d9c-96e6-fc8b40802c90 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:51.249387 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-5de68e55-2c45-4d9c-96e6-fc8b40802c90 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:51.249826 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-5de68e55-2c45-4d9c-96e6-fc8b40802c90 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:51.463868 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-409e7e59-14c2-4416-b4fb-c6058e3ac587 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:51.464608 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-409e7e59-14c2-4416-b4fb-c6058e3ac587 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] [instance: edce90bf-b3d6-49de-a45f-9b65e1759b51] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:51.475800 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-409e7e59-14c2-4416-b4fb-c6058e3ac587 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:51.477436 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-409e7e59-14c2-4416-b4fb-c6058e3ac587 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:51.481149 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-409e7e59-14c2-4416-b4fb-c6058e3ac587 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:51.481963 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-409e7e59-14c2-4416-b4fb-c6058e3ac587 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:51.636255 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-5de68e55-2c45-4d9c-96e6-fc8b40802c90 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:51.645711 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-5de68e55-2c45-4d9c-96e6-fc8b40802c90 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f" status: 200 len: 1371 microversion: 2.1 time: 0.412870 Jun 16 19:01:51.648497 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 145/284] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:51 2022] GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f => generated 1371 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:51.737956 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-19c993ee-0560-4160-9266-cbbb7e6becf4 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:51.739181 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-19c993ee-0560-4160-9266-cbbb7e6becf4 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:51.750193 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-19c993ee-0560-4160-9266-cbbb7e6becf4 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:51.750742 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-19c993ee-0560-4160-9266-cbbb7e6becf4 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:51.752684 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-19c993ee-0560-4160-9266-cbbb7e6becf4 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:51.753154 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-19c993ee-0560-4160-9266-cbbb7e6becf4 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:51.861310 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-409e7e59-14c2-4416-b4fb-c6058e3ac587 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047e841cefdd4975947b2c154412953b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741ee13164894b49be1a0fc6c1385a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:51.879549 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-409e7e59-14c2-4416-b4fb-c6058e3ac587 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] 10.222.0.70 "GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51" status: 200 len: 1359 microversion: 2.1 time: 0.421419 Jun 16 19:01:51.880137 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 140/285] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:51 2022] GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51 => generated 1359 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:01:51.988957 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-19c993ee-0560-4160-9266-cbbb7e6becf4 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:51.999879 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-19c993ee-0560-4160-9266-cbbb7e6becf4 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:52.004775 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-19c993ee-0560-4160-9266-cbbb7e6becf4 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:52.007265 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-19c993ee-0560-4160-9266-cbbb7e6becf4 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1723 microversion: 2.20 time: 0.273694 Jun 16 19:01:52.015846 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 146/286] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:01:51 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1723 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:01:52.666258 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-60a8a8d1-97b5-4d8c-b8bf-4de83e588c38 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:52.667913 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-60a8a8d1-97b5-4d8c-b8bf-4de83e588c38 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:52.676632 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-60a8a8d1-97b5-4d8c-b8bf-4de83e588c38 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:52.677665 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-60a8a8d1-97b5-4d8c-b8bf-4de83e588c38 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:52.678693 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-60a8a8d1-97b5-4d8c-b8bf-4de83e588c38 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:52.679313 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-60a8a8d1-97b5-4d8c-b8bf-4de83e588c38 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:52.849561 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-60a8a8d1-97b5-4d8c-b8bf-4de83e588c38 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:52.879093 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-60a8a8d1-97b5-4d8c-b8bf-4de83e588c38 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f" status: 200 len: 1371 microversion: 2.1 time: 0.198151 Jun 16 19:01:52.880437 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 141/287] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:52 2022] GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f => generated 1371 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:52.899372 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-82bb56d6-7445-465f-a26f-cabfa111f276 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:52.899999 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-82bb56d6-7445-465f-a26f-cabfa111f276 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] [instance: edce90bf-b3d6-49de-a45f-9b65e1759b51] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:52.906615 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:01:52.916655 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-82bb56d6-7445-465f-a26f-cabfa111f276 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:52.917541 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-82bb56d6-7445-465f-a26f-cabfa111f276 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:52.918327 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-82bb56d6-7445-465f-a26f-cabfa111f276 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:52.918761 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-82bb56d6-7445-465f-a26f-cabfa111f276 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:53.036693 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-a52aacfc-2e53-48d9-a09e-dcadb7ec2907 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:53.038260 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-a52aacfc-2e53-48d9-a09e-dcadb7ec2907 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:53.045297 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-a52aacfc-2e53-48d9-a09e-dcadb7ec2907 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:53.045759 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-a52aacfc-2e53-48d9-a09e-dcadb7ec2907 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:53.046733 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-a52aacfc-2e53-48d9-a09e-dcadb7ec2907 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:53.047248 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-a52aacfc-2e53-48d9-a09e-dcadb7ec2907 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:53.101819 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-82bb56d6-7445-465f-a26f-cabfa111f276 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047e841cefdd4975947b2c154412953b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741ee13164894b49be1a0fc6c1385a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:53.111296 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-82bb56d6-7445-465f-a26f-cabfa111f276 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] 10.222.0.70 "GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51" status: 200 len: 1359 microversion: 2.1 time: 0.216014 Jun 16 19:01:53.112186 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 147/288] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:52 2022] GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51 => generated 1359 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:53.225183 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-a52aacfc-2e53-48d9-a09e-dcadb7ec2907 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:53.236602 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-a52aacfc-2e53-48d9-a09e-dcadb7ec2907 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:53.238151 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-a52aacfc-2e53-48d9-a09e-dcadb7ec2907 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:53.239397 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-a52aacfc-2e53-48d9-a09e-dcadb7ec2907 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1723 microversion: 2.20 time: 0.207653 Jun 16 19:01:53.239948 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 142/289] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:01:53 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1723 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:01:53.897760 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-6c21d3ba-0711-49b8-a87d-229bf7e5c57a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:53.898627 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-6c21d3ba-0711-49b8-a87d-229bf7e5c57a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:53.906131 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-6c21d3ba-0711-49b8-a87d-229bf7e5c57a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:53.906822 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-6c21d3ba-0711-49b8-a87d-229bf7e5c57a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:53.907349 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-6c21d3ba-0711-49b8-a87d-229bf7e5c57a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:53.907783 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-6c21d3ba-0711-49b8-a87d-229bf7e5c57a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:54.143382 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-93e241b8-8aea-4884-8141-d9309f535ae5 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:54.147190 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-93e241b8-8aea-4884-8141-d9309f535ae5 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] [instance: edce90bf-b3d6-49de-a45f-9b65e1759b51] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:54.172841 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-93e241b8-8aea-4884-8141-d9309f535ae5 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:54.173635 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-93e241b8-8aea-4884-8141-d9309f535ae5 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:54.182827 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-93e241b8-8aea-4884-8141-d9309f535ae5 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:54.183752 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-93e241b8-8aea-4884-8141-d9309f535ae5 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:54.349023 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-6c21d3ba-0711-49b8-a87d-229bf7e5c57a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:54.372739 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-6c21d3ba-0711-49b8-a87d-229bf7e5c57a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f" status: 200 len: 1371 microversion: 2.1 time: 0.478585 Jun 16 19:01:54.374472 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 148/290] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:53 2022] GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f => generated 1371 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:54.381400 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-2db275df-3e55-4e79-a59c-54fbe8b868e0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:54.384106 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-2db275df-3e55-4e79-a59c-54fbe8b868e0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:54.396676 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-2db275df-3e55-4e79-a59c-54fbe8b868e0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:54.397795 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-2db275df-3e55-4e79-a59c-54fbe8b868e0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:54.401306 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-2db275df-3e55-4e79-a59c-54fbe8b868e0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:54.403733 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-2db275df-3e55-4e79-a59c-54fbe8b868e0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:54.412054 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_cell1:SELECT=100 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:01:54.524070 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-93e241b8-8aea-4884-8141-d9309f535ae5 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047e841cefdd4975947b2c154412953b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741ee13164894b49be1a0fc6c1385a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:54.549888 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-93e241b8-8aea-4884-8141-d9309f535ae5 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] 10.222.0.70 "GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51" status: 200 len: 1359 microversion: 2.1 time: 0.421188 Jun 16 19:01:54.551134 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 143/291] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:54 2022] GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51 => generated 1359 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:54.678736 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-2db275df-3e55-4e79-a59c-54fbe8b868e0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:54.690685 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-2db275df-3e55-4e79-a59c-54fbe8b868e0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:54.692311 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-2db275df-3e55-4e79-a59c-54fbe8b868e0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:54.693501 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-2db275df-3e55-4e79-a59c-54fbe8b868e0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1723 microversion: 2.20 time: 0.317875 Jun 16 19:01:54.694190 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 149/292] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:01:54 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1723 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:01:55.092990 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [req-b05f1a02-0e95-42b0-aeca-8c2814c375a4 req-240d0d35-8594-494a-8f2e-d94dc197ee6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdd6d861-ef2f-4b74-ba61-41178438391f", "tag": "1ac6c4c7-65ae-4602-b8de-8ddcba59c0e5"}]} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:01:55.127050 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-b05f1a02-0e95-42b0-aeca-8c2814c375a4 req-240d0d35-8594-494a-8f2e-d94dc197ee6a service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:55.127506 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-b05f1a02-0e95-42b0-aeca-8c2814c375a4 req-240d0d35-8594-494a-8f2e-d94dc197ee6a service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:55.164086 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.compute.server_external_events [req-b05f1a02-0e95-42b0-aeca-8c2814c375a4 req-240d0d35-8594-494a-8f2e-d94dc197ee6a service nova] Creating event network-changed:1ac6c4c7-65ae-4602-b8de-8ddcba59c0e5 for instance fdd6d861-ef2f-4b74-ba61-41178438391f on hv-cinder-84617 Jun 16 19:01:55.176948 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [req-b05f1a02-0e95-42b0-aeca-8c2814c375a4 req-240d0d35-8594-494a-8f2e-d94dc197ee6a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088755 Jun 16 19:01:55.177959 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 144/293] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:01:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:01:55.327191 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [req-7c2f5ef0-cedf-4c0c-97e0-3f82d40b1d7d req-8cb8ba72-65ce-44ee-8231-fbf96ec103ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edce90bf-b3d6-49de-a45f-9b65e1759b51", "tag": "1ff09938-bf10-4206-8fd9-6a39acb93f8c"}]} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:01:55.352120 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-7c2f5ef0-cedf-4c0c-97e0-3f82d40b1d7d req-8cb8ba72-65ce-44ee-8231-fbf96ec103ab service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:55.352739 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-7c2f5ef0-cedf-4c0c-97e0-3f82d40b1d7d req-8cb8ba72-65ce-44ee-8231-fbf96ec103ab service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:55.382257 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.compute.server_external_events [req-7c2f5ef0-cedf-4c0c-97e0-3f82d40b1d7d req-8cb8ba72-65ce-44ee-8231-fbf96ec103ab service nova] Creating event network-changed:1ff09938-bf10-4206-8fd9-6a39acb93f8c for instance edce90bf-b3d6-49de-a45f-9b65e1759b51 on hv-cinder-84617 Jun 16 19:01:55.395479 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-037abc16-8fc1-46c5-ba47-51628912d692 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:55.396511 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-037abc16-8fc1-46c5-ba47-51628912d692 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:55.408905 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [req-7c2f5ef0-cedf-4c0c-97e0-3f82d40b1d7d req-8cb8ba72-65ce-44ee-8231-fbf96ec103ab service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086905 Jun 16 19:01:55.412439 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-037abc16-8fc1-46c5-ba47-51628912d692 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:55.412920 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 150/294] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:01:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:01:55.413553 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-037abc16-8fc1-46c5-ba47-51628912d692 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:55.414531 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-037abc16-8fc1-46c5-ba47-51628912d692 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:55.415182 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-037abc16-8fc1-46c5-ba47-51628912d692 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:55.569469 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-fe90b335-1c82-4727-aebd-ee22bf12149b tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:55.570932 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-fe90b335-1c82-4727-aebd-ee22bf12149b tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] [instance: edce90bf-b3d6-49de-a45f-9b65e1759b51] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:55.587889 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-fe90b335-1c82-4727-aebd-ee22bf12149b tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:55.588602 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-fe90b335-1c82-4727-aebd-ee22bf12149b tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:55.591388 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-fe90b335-1c82-4727-aebd-ee22bf12149b tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:55.592145 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-fe90b335-1c82-4727-aebd-ee22bf12149b tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:55.722590 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-037abc16-8fc1-46c5-ba47-51628912d692 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:55.736884 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-037abc16-8fc1-46c5-ba47-51628912d692 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f" status: 200 len: 1371 microversion: 2.1 time: 0.347903 Jun 16 19:01:55.751424 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 145/295] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:55 2022] GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f => generated 1371 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:55.766320 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-e8c7405a-8aeb-4b9e-b0b5-7e25c10750b8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:55.766982 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-e8c7405a-8aeb-4b9e-b0b5-7e25c10750b8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:55.773252 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-e8c7405a-8aeb-4b9e-b0b5-7e25c10750b8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:55.773702 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-e8c7405a-8aeb-4b9e-b0b5-7e25c10750b8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:55.774459 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-e8c7405a-8aeb-4b9e-b0b5-7e25c10750b8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:55.775305 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-e8c7405a-8aeb-4b9e-b0b5-7e25c10750b8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:56.133674 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-fe90b335-1c82-4727-aebd-ee22bf12149b tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047e841cefdd4975947b2c154412953b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741ee13164894b49be1a0fc6c1385a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:56.145875 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-fe90b335-1c82-4727-aebd-ee22bf12149b tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] 10.222.0.70 "GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51" status: 200 len: 1359 microversion: 2.1 time: 0.581083 Jun 16 19:01:56.146606 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 151/296] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:55 2022] GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51 => generated 1359 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:56.153083 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-97440bae-4736-4039-a5ee-dca0ca8ff21a tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:01:56.159631 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-97440bae-4736-4039-a5ee-dca0ca8ff21a tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:56.160087 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-97440bae-4736-4039-a5ee-dca0ca8ff21a tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:56.254546 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-e8c7405a-8aeb-4b9e-b0b5-7e25c10750b8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:56.264701 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-97440bae-4736-4039-a5ee-dca0ca8ff21a tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Going to try to stop instance {{(pid=117852) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 16 19:01:56.272450 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-e8c7405a-8aeb-4b9e-b0b5-7e25c10750b8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:56.273958 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-e8c7405a-8aeb-4b9e-b0b5-7e25c10750b8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:56.275422 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-e8c7405a-8aeb-4b9e-b0b5-7e25c10750b8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1723 microversion: 2.20 time: 0.522733 Jun 16 19:01:56.276845 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 146/297] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:01:55 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1723 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:01:56.319310 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-97440bae-4736-4039-a5ee-dca0ca8ff21a tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "POST /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee/action" status: 202 len: 0 microversion: 2.1 time: 0.170828 Jun 16 19:01:56.319791 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 152/298] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Jun 16 19:01:56 2022] POST /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:01:56.328777 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-5112d4d6-6b44-459a-81f1-650766ce2d96 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:56.329393 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-5112d4d6-6b44-459a-81f1-650766ce2d96 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:56.331372 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=4 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:01:56.336689 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-5112d4d6-6b44-459a-81f1-650766ce2d96 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:56.337136 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-5112d4d6-6b44-459a-81f1-650766ce2d96 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:56.337889 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-5112d4d6-6b44-459a-81f1-650766ce2d96 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:56.338320 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-5112d4d6-6b44-459a-81f1-650766ce2d96 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:56.474501 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-5112d4d6-6b44-459a-81f1-650766ce2d96 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:56.483074 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-5112d4d6-6b44-459a-81f1-650766ce2d96 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1722 microversion: 2.1 time: 0.158170 Jun 16 19:01:56.483638 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 147/299] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:56 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:56.769978 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-a5e63f92-5aa5-4e39-a0b2-f0d8a61c2a61 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:56.770967 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-a5e63f92-5aa5-4e39-a0b2-f0d8a61c2a61 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:56.778718 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-a5e63f92-5aa5-4e39-a0b2-f0d8a61c2a61 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:56.779300 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-a5e63f92-5aa5-4e39-a0b2-f0d8a61c2a61 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:56.780179 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-a5e63f92-5aa5-4e39-a0b2-f0d8a61c2a61 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:56.780614 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-a5e63f92-5aa5-4e39-a0b2-f0d8a61c2a61 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:56.933801 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-a5e63f92-5aa5-4e39-a0b2-f0d8a61c2a61 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:56.941248 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-a5e63f92-5aa5-4e39-a0b2-f0d8a61c2a61 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f" status: 200 len: 1371 microversion: 2.1 time: 0.175391 Jun 16 19:01:56.941807 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 153/300] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:56 2022] GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f => generated 1371 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:57.166783 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-5f6241be-bd72-4ba0-8d7e-605d8408d027 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:57.166783 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-5f6241be-bd72-4ba0-8d7e-605d8408d027 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] [instance: edce90bf-b3d6-49de-a45f-9b65e1759b51] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:57.173555 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-5f6241be-bd72-4ba0-8d7e-605d8408d027 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:57.174007 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-5f6241be-bd72-4ba0-8d7e-605d8408d027 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:57.174805 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-5f6241be-bd72-4ba0-8d7e-605d8408d027 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:57.175540 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-5f6241be-bd72-4ba0-8d7e-605d8408d027 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:57.299313 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-83ed205b-5d8e-4c86-b14c-75ecd1ee9eee tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:57.300256 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-83ed205b-5d8e-4c86-b14c-75ecd1ee9eee tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:57.310305 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-83ed205b-5d8e-4c86-b14c-75ecd1ee9eee tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:57.311615 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-83ed205b-5d8e-4c86-b14c-75ecd1ee9eee tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:57.312517 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-83ed205b-5d8e-4c86-b14c-75ecd1ee9eee tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:57.312963 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-83ed205b-5d8e-4c86-b14c-75ecd1ee9eee tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:57.330533 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-5f6241be-bd72-4ba0-8d7e-605d8408d027 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047e841cefdd4975947b2c154412953b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741ee13164894b49be1a0fc6c1385a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:57.332768 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_cell1:SELECT=100 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:01:57.341580 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-5f6241be-bd72-4ba0-8d7e-605d8408d027 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] 10.222.0.70 "GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51" status: 200 len: 1359 microversion: 2.1 time: 0.181230 Jun 16 19:01:57.351091 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 148/301] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:57 2022] GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51 => generated 1359 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:57.484229 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-83ed205b-5d8e-4c86-b14c-75ecd1ee9eee tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:57.492269 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-83ed205b-5d8e-4c86-b14c-75ecd1ee9eee tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:57.494612 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-83ed205b-5d8e-4c86-b14c-75ecd1ee9eee tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:57.496623 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-83ed205b-5d8e-4c86-b14c-75ecd1ee9eee tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1723 microversion: 2.20 time: 0.204409 Jun 16 19:01:57.497254 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 154/302] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:01:57 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1723 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:01:57.511204 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-0d480b43-e255-484b-ba63-30b016b5053f tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:57.512024 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-0d480b43-e255-484b-ba63-30b016b5053f tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:57.518352 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0d480b43-e255-484b-ba63-30b016b5053f tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:57.518841 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0d480b43-e255-484b-ba63-30b016b5053f tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:57.519608 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0d480b43-e255-484b-ba63-30b016b5053f tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:57.520047 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0d480b43-e255-484b-ba63-30b016b5053f tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:57.671158 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-0d480b43-e255-484b-ba63-30b016b5053f tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:57.679277 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-0d480b43-e255-484b-ba63-30b016b5053f tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1722 microversion: 2.1 time: 0.181643 Jun 16 19:01:57.679924 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 149/303] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:57 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:01:57.958701 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-042c840f-bbf3-4b29-94a9-c2aad5885a0e tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:57.959353 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-042c840f-bbf3-4b29-94a9-c2aad5885a0e tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:57.966372 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-042c840f-bbf3-4b29-94a9-c2aad5885a0e tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:57.966847 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-042c840f-bbf3-4b29-94a9-c2aad5885a0e tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:57.967620 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-042c840f-bbf3-4b29-94a9-c2aad5885a0e tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:57.968067 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-042c840f-bbf3-4b29-94a9-c2aad5885a0e tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:58.114068 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-042c840f-bbf3-4b29-94a9-c2aad5885a0e tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:58.121945 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-042c840f-bbf3-4b29-94a9-c2aad5885a0e tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f" status: 200 len: 1371 microversion: 2.1 time: 0.167172 Jun 16 19:01:58.122443 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 155/304] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:57 2022] GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:58.359185 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-06e18af1-4a6c-4c73-b38f-5ce65652a171 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:58.359861 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-06e18af1-4a6c-4c73-b38f-5ce65652a171 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] [instance: edce90bf-b3d6-49de-a45f-9b65e1759b51] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:58.376565 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-06e18af1-4a6c-4c73-b38f-5ce65652a171 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:58.377185 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-06e18af1-4a6c-4c73-b38f-5ce65652a171 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:58.378110 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-06e18af1-4a6c-4c73-b38f-5ce65652a171 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:58.378998 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-06e18af1-4a6c-4c73-b38f-5ce65652a171 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:58.516284 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-49d13192-daab-4869-8cf5-a2dac012aa57 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:58.517053 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-49d13192-daab-4869-8cf5-a2dac012aa57 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:58.523162 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-49d13192-daab-4869-8cf5-a2dac012aa57 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:58.523688 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-49d13192-daab-4869-8cf5-a2dac012aa57 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:58.524528 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-49d13192-daab-4869-8cf5-a2dac012aa57 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:58.525042 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-49d13192-daab-4869-8cf5-a2dac012aa57 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:58.532834 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-06e18af1-4a6c-4c73-b38f-5ce65652a171 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047e841cefdd4975947b2c154412953b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741ee13164894b49be1a0fc6c1385a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:58.540217 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-06e18af1-4a6c-4c73-b38f-5ce65652a171 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] 10.222.0.70 "GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51" status: 200 len: 1359 microversion: 2.1 time: 0.186549 Jun 16 19:01:58.540889 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 150/305] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:58 2022] GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51 => generated 1359 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:58.660046 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-49d13192-daab-4869-8cf5-a2dac012aa57 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:58.668228 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-49d13192-daab-4869-8cf5-a2dac012aa57 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:58.669755 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-49d13192-daab-4869-8cf5-a2dac012aa57 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:58.671020 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-49d13192-daab-4869-8cf5-a2dac012aa57 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1723 microversion: 2.20 time: 0.158854 Jun 16 19:01:58.671839 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 156/306] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:01:58 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:01:58.696920 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-cfce531c-a74e-4a53-8588-396209e6b5cd tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:58.697586 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-cfce531c-a74e-4a53-8588-396209e6b5cd tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:58.704353 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-cfce531c-a74e-4a53-8588-396209e6b5cd tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:58.704799 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-cfce531c-a74e-4a53-8588-396209e6b5cd tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:58.705606 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-cfce531c-a74e-4a53-8588-396209e6b5cd tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:58.706040 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-cfce531c-a74e-4a53-8588-396209e6b5cd tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:58.842519 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-cfce531c-a74e-4a53-8588-396209e6b5cd tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:58.851083 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-cfce531c-a74e-4a53-8588-396209e6b5cd tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1722 microversion: 2.1 time: 0.157912 Jun 16 19:01:58.852042 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 151/307] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:58 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:59.139288 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-3246c0bc-f73f-4d0a-984b-906cce36e48e tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:59.139893 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-3246c0bc-f73f-4d0a-984b-906cce36e48e tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:59.146293 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-3246c0bc-f73f-4d0a-984b-906cce36e48e tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:59.146775 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-3246c0bc-f73f-4d0a-984b-906cce36e48e tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:59.147520 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-3246c0bc-f73f-4d0a-984b-906cce36e48e tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:59.147949 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-3246c0bc-f73f-4d0a-984b-906cce36e48e tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:59.347129 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-3246c0bc-f73f-4d0a-984b-906cce36e48e tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:59.355789 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-3246c0bc-f73f-4d0a-984b-906cce36e48e tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f" status: 200 len: 1371 microversion: 2.1 time: 0.220742 Jun 16 19:01:59.364911 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 157/308] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:59 2022] GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f => generated 1371 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:01:59.537651 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-9fb9bc4c-b56d-48c3-a6b1-fdffca57fb5f tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-467216350", "imageRef": "1d993e69-7f01-4fe0-ba52-0eae2fa43ddf", "flavorRef": "452"}} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:01:59.558350 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-0b464bfb-2656-4550-8cb6-68118875145c tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:59.558597 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-0b464bfb-2656-4550-8cb6-68118875145c tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] [instance: edce90bf-b3d6-49de-a45f-9b65e1759b51] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:59.564944 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-0b464bfb-2656-4550-8cb6-68118875145c tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:59.565530 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-0b464bfb-2656-4550-8cb6-68118875145c tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:59.566436 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-0b464bfb-2656-4550-8cb6-68118875145c tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:59.567020 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-0b464bfb-2656-4550-8cb6-68118875145c tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:59.779404 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-0b464bfb-2656-4550-8cb6-68118875145c tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047e841cefdd4975947b2c154412953b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741ee13164894b49be1a0fc6c1385a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:01:59.796641 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-0b464bfb-2656-4550-8cb6-68118875145c tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] 10.222.0.70 "GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51" status: 200 len: 1359 microversion: 2.1 time: 0.243347 Jun 16 19:01:59.797373 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 158/309] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:01:59 2022] GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51 => generated 1359 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:01:59.802468 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-8aa4ca9f-48b0-4872-a2c3-2faef9857ee9 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:01:59.803329 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-8aa4ca9f-48b0-4872-a2c3-2faef9857ee9 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:01:59.810014 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-8aa4ca9f-48b0-4872-a2c3-2faef9857ee9 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:59.810460 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-8aa4ca9f-48b0-4872-a2c3-2faef9857ee9 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:01:59.811251 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-8aa4ca9f-48b0-4872-a2c3-2faef9857ee9 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:01:59.811682 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-8aa4ca9f-48b0-4872-a2c3-2faef9857ee9 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:00.007918 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-8aa4ca9f-48b0-4872-a2c3-2faef9857ee9 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:00.017088 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-8aa4ca9f-48b0-4872-a2c3-2faef9857ee9 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:00.018671 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-8aa4ca9f-48b0-4872-a2c3-2faef9857ee9 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:00.019830 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-8aa4ca9f-48b0-4872-a2c3-2faef9857ee9 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1744 microversion: 2.20 time: 0.221280 Jun 16 19:02:00.020382 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 159/310] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:01:59 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1744 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:02:00.025238 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-4bd575e7-f20a-489e-a804-513a2e214473 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:00.026938 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-4bd575e7-f20a-489e-a804-513a2e214473 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:00.033743 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-4bd575e7-f20a-489e-a804-513a2e214473 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:00.034195 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-4bd575e7-f20a-489e-a804-513a2e214473 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:00.035074 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-4bd575e7-f20a-489e-a804-513a2e214473 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:00.035517 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-4bd575e7-f20a-489e-a804-513a2e214473 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:00.182927 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-4bd575e7-f20a-489e-a804-513a2e214473 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:00.192963 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-4bd575e7-f20a-489e-a804-513a2e214473 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1722 microversion: 2.1 time: 0.171226 Jun 16 19:02:00.193546 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 160/311] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:00 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:00.375632 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-a773fe8f-34c3-446c-be41-a1a538986337 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:00.377466 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-a773fe8f-34c3-446c-be41-a1a538986337 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:00.385460 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-a773fe8f-34c3-446c-be41-a1a538986337 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:00.386677 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-a773fe8f-34c3-446c-be41-a1a538986337 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:00.387601 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-a773fe8f-34c3-446c-be41-a1a538986337 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:00.388130 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-a773fe8f-34c3-446c-be41-a1a538986337 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:00.541379 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-a773fe8f-34c3-446c-be41-a1a538986337 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:00.549696 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-a773fe8f-34c3-446c-be41-a1a538986337 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f" status: 200 len: 1371 microversion: 2.1 time: 0.180851 Jun 16 19:02:00.550263 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 161/312] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:00 2022] GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f => generated 1371 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:02:00.814066 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-6d58aef1-de42-4c02-851e-acb42f382dbb tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:00.814711 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-6d58aef1-de42-4c02-851e-acb42f382dbb tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] [instance: edce90bf-b3d6-49de-a45f-9b65e1759b51] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:00.820729 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-6d58aef1-de42-4c02-851e-acb42f382dbb tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:00.821170 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-6d58aef1-de42-4c02-851e-acb42f382dbb tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:00.821919 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-6d58aef1-de42-4c02-851e-acb42f382dbb tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:00.822344 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-6d58aef1-de42-4c02-851e-acb42f382dbb tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:00.958434 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-6d58aef1-de42-4c02-851e-acb42f382dbb tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047e841cefdd4975947b2c154412953b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741ee13164894b49be1a0fc6c1385a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:00.966235 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-6d58aef1-de42-4c02-851e-acb42f382dbb tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] 10.222.0.70 "GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51" status: 200 len: 1359 microversion: 2.1 time: 0.156110 Jun 16 19:02:00.966814 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 162/313] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:00 2022] GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:02:01.039522 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-5ff71840-4155-403e-8242-4ae4311c3427 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:01.040128 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-5ff71840-4155-403e-8242-4ae4311c3427 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:01.047617 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-5ff71840-4155-403e-8242-4ae4311c3427 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:01.048066 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-5ff71840-4155-403e-8242-4ae4311c3427 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:01.048822 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-5ff71840-4155-403e-8242-4ae4311c3427 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:01.049258 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-5ff71840-4155-403e-8242-4ae4311c3427 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:01.185828 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-5ff71840-4155-403e-8242-4ae4311c3427 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:01.194093 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-5ff71840-4155-403e-8242-4ae4311c3427 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:01.195622 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-5ff71840-4155-403e-8242-4ae4311c3427 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:01.196791 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-5ff71840-4155-403e-8242-4ae4311c3427 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1744 microversion: 2.20 time: 0.161229 Jun 16 19:02:01.197478 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 163/314] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:01 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:02:01.215242 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-55bb17d7-e27f-4af7-aa39-66e9e3b762b3 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:01.216004 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-55bb17d7-e27f-4af7-aa39-66e9e3b762b3 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:01.221993 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-55bb17d7-e27f-4af7-aa39-66e9e3b762b3 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:01.222442 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-55bb17d7-e27f-4af7-aa39-66e9e3b762b3 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:01.223254 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-55bb17d7-e27f-4af7-aa39-66e9e3b762b3 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:01.223691 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-55bb17d7-e27f-4af7-aa39-66e9e3b762b3 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:01.361840 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-55bb17d7-e27f-4af7-aa39-66e9e3b762b3 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:01.370769 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-55bb17d7-e27f-4af7-aa39-66e9e3b762b3 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1722 microversion: 2.1 time: 0.159279 Jun 16 19:02:01.371507 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 164/315] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:01 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:01.566643 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-a4a7eea9-a59b-4b02-9ec0-028b557602be tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:01.567523 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-a4a7eea9-a59b-4b02-9ec0-028b557602be tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:01.574423 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-a4a7eea9-a59b-4b02-9ec0-028b557602be tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:01.575071 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-a4a7eea9-a59b-4b02-9ec0-028b557602be tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:01.575838 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-a4a7eea9-a59b-4b02-9ec0-028b557602be tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:01.576274 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-a4a7eea9-a59b-4b02-9ec0-028b557602be tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:01.592149 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:02:01.718720 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-a4a7eea9-a59b-4b02-9ec0-028b557602be tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:01.726302 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-a4a7eea9-a59b-4b02-9ec0-028b557602be tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f" status: 200 len: 1371 microversion: 2.1 time: 0.163697 Jun 16 19:02:01.726899 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 165/316] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:01 2022] GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:02:01.983766 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-857e8b6a-488d-4cac-b01a-a525ba8a6a4f tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:01.984382 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-857e8b6a-488d-4cac-b01a-a525ba8a6a4f tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] [instance: edce90bf-b3d6-49de-a45f-9b65e1759b51] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:01.990536 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-857e8b6a-488d-4cac-b01a-a525ba8a6a4f tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:01.991016 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-857e8b6a-488d-4cac-b01a-a525ba8a6a4f tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:01.991826 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-857e8b6a-488d-4cac-b01a-a525ba8a6a4f tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:01.992266 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-857e8b6a-488d-4cac-b01a-a525ba8a6a4f tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:02.123342 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-857e8b6a-488d-4cac-b01a-a525ba8a6a4f tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047e841cefdd4975947b2c154412953b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741ee13164894b49be1a0fc6c1385a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:02.130701 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-857e8b6a-488d-4cac-b01a-a525ba8a6a4f tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] 10.222.0.70 "GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51" status: 200 len: 1359 microversion: 2.1 time: 0.151693 Jun 16 19:02:02.131262 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 166/317] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:01 2022] GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:02:02.217275 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-5c1fdc7a-5ebf-4e1f-b53c-4897fb1efcf5 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:02.218027 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-5c1fdc7a-5ebf-4e1f-b53c-4897fb1efcf5 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:02.224417 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-5c1fdc7a-5ebf-4e1f-b53c-4897fb1efcf5 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:02.224856 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-5c1fdc7a-5ebf-4e1f-b53c-4897fb1efcf5 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:02.225604 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-5c1fdc7a-5ebf-4e1f-b53c-4897fb1efcf5 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:02.226030 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-5c1fdc7a-5ebf-4e1f-b53c-4897fb1efcf5 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:02.357145 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-5c1fdc7a-5ebf-4e1f-b53c-4897fb1efcf5 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:02.365928 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-5c1fdc7a-5ebf-4e1f-b53c-4897fb1efcf5 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:02.367596 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-5c1fdc7a-5ebf-4e1f-b53c-4897fb1efcf5 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:02.368826 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-5c1fdc7a-5ebf-4e1f-b53c-4897fb1efcf5 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1744 microversion: 2.20 time: 0.156213 Jun 16 19:02:02.369379 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 167/318] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:02 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:02:02.389736 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-841e75f9-61fa-47cb-bf36-09ab4ba9cb8f tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:02.390270 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-841e75f9-61fa-47cb-bf36-09ab4ba9cb8f tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:02.396705 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-841e75f9-61fa-47cb-bf36-09ab4ba9cb8f tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:02.397237 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-841e75f9-61fa-47cb-bf36-09ab4ba9cb8f tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:02.398089 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-841e75f9-61fa-47cb-bf36-09ab4ba9cb8f tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:02.398529 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-841e75f9-61fa-47cb-bf36-09ab4ba9cb8f tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:02.535525 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-841e75f9-61fa-47cb-bf36-09ab4ba9cb8f tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:02.544304 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-841e75f9-61fa-47cb-bf36-09ab4ba9cb8f tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1722 microversion: 2.1 time: 0.159062 Jun 16 19:02:02.545061 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 168/319] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:02 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:02:02.743879 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-32f17213-2361-4c9f-a9e6-778691b7f9c7 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:02.744486 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-32f17213-2361-4c9f-a9e6-778691b7f9c7 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:02.751070 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-32f17213-2361-4c9f-a9e6-778691b7f9c7 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:02.751516 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-32f17213-2361-4c9f-a9e6-778691b7f9c7 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:02.752270 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-32f17213-2361-4c9f-a9e6-778691b7f9c7 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:02.752704 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-32f17213-2361-4c9f-a9e6-778691b7f9c7 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:02.890082 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-32f17213-2361-4c9f-a9e6-778691b7f9c7 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:02.897564 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-32f17213-2361-4c9f-a9e6-778691b7f9c7 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f" status: 200 len: 1371 microversion: 2.1 time: 0.157665 Jun 16 19:02:02.898122 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 169/320] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:02 2022] GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:02:03.147665 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-72f14c49-e00f-43d3-9b5d-f543fec990ec tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:03.148279 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-72f14c49-e00f-43d3-9b5d-f543fec990ec tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] [instance: edce90bf-b3d6-49de-a45f-9b65e1759b51] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:03.157258 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-72f14c49-e00f-43d3-9b5d-f543fec990ec tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:03.157716 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-72f14c49-e00f-43d3-9b5d-f543fec990ec tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:03.158765 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-72f14c49-e00f-43d3-9b5d-f543fec990ec tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:03.159539 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-72f14c49-e00f-43d3-9b5d-f543fec990ec tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:03.299515 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-72f14c49-e00f-43d3-9b5d-f543fec990ec tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047e841cefdd4975947b2c154412953b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741ee13164894b49be1a0fc6c1385a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:03.307093 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-72f14c49-e00f-43d3-9b5d-f543fec990ec tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] 10.222.0.70 "GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51" status: 200 len: 1359 microversion: 2.1 time: 0.163322 Jun 16 19:02:03.308173 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 170/321] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:03 2022] GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:02:03.387717 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-2523bae2-fd45-4bf3-ba79-3e3bbd37d6c4 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:03.388318 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-2523bae2-fd45-4bf3-ba79-3e3bbd37d6c4 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:03.394948 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-2523bae2-fd45-4bf3-ba79-3e3bbd37d6c4 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:03.395545 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-2523bae2-fd45-4bf3-ba79-3e3bbd37d6c4 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:03.396369 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-2523bae2-fd45-4bf3-ba79-3e3bbd37d6c4 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:03.396806 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-2523bae2-fd45-4bf3-ba79-3e3bbd37d6c4 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:03.536488 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-2523bae2-fd45-4bf3-ba79-3e3bbd37d6c4 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:03.545377 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-2523bae2-fd45-4bf3-ba79-3e3bbd37d6c4 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:03.547051 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-2523bae2-fd45-4bf3-ba79-3e3bbd37d6c4 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:03.548379 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-2523bae2-fd45-4bf3-ba79-3e3bbd37d6c4 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1739 microversion: 2.20 time: 0.165015 Jun 16 19:02:03.548933 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 171/322] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:03 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1739 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:02:03.564323 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-529b3ac5-f7a9-42b6-9aad-eaa8dfff7aa1 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:03.564970 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-529b3ac5-f7a9-42b6-9aad-eaa8dfff7aa1 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:03.571919 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-529b3ac5-f7a9-42b6-9aad-eaa8dfff7aa1 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:03.572389 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-529b3ac5-f7a9-42b6-9aad-eaa8dfff7aa1 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:03.573362 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-529b3ac5-f7a9-42b6-9aad-eaa8dfff7aa1 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:03.573718 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-529b3ac5-f7a9-42b6-9aad-eaa8dfff7aa1 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:03.737603 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-529b3ac5-f7a9-42b6-9aad-eaa8dfff7aa1 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:03.748528 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-529b3ac5-f7a9-42b6-9aad-eaa8dfff7aa1 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1722 microversion: 2.1 time: 0.188129 Jun 16 19:02:03.749236 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 172/323] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:03 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1722 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:02:03.765158 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [req-3c9934db-5ea6-4ab0-bf18-0323a89df665 req-4e696314-6d5f-4ecc-a39b-79ad32015432 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edce90bf-b3d6-49de-a45f-9b65e1759b51", "name": "network-vif-plugged", "status": "completed", "tag": "1ff09938-bf10-4206-8fd9-6a39acb93f8c"}]} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:02:03.780666 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-3c9934db-5ea6-4ab0-bf18-0323a89df665 req-4e696314-6d5f-4ecc-a39b-79ad32015432 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:03.781298 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-3c9934db-5ea6-4ab0-bf18-0323a89df665 req-4e696314-6d5f-4ecc-a39b-79ad32015432 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:03.795292 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.compute.server_external_events [req-3c9934db-5ea6-4ab0-bf18-0323a89df665 req-4e696314-6d5f-4ecc-a39b-79ad32015432 service nova] Creating event network-vif-plugged:1ff09938-bf10-4206-8fd9-6a39acb93f8c for instance edce90bf-b3d6-49de-a45f-9b65e1759b51 on hv-cinder-84617 Jun 16 19:02:03.800536 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [req-3c9934db-5ea6-4ab0-bf18-0323a89df665 req-4e696314-6d5f-4ecc-a39b-79ad32015432 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041227 Jun 16 19:02:03.801299 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 173/324] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:02:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:02:03.917730 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-9b2014d2-e467-4f19-9d7b-2d631f8fe663 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:03.918914 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-9b2014d2-e467-4f19-9d7b-2d631f8fe663 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:03.925723 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-9b2014d2-e467-4f19-9d7b-2d631f8fe663 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:03.926290 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-9b2014d2-e467-4f19-9d7b-2d631f8fe663 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:03.927280 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-9b2014d2-e467-4f19-9d7b-2d631f8fe663 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:03.927927 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-9b2014d2-e467-4f19-9d7b-2d631f8fe663 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:04.084891 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-9b2014d2-e467-4f19-9d7b-2d631f8fe663 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:04.094302 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-9b2014d2-e467-4f19-9d7b-2d631f8fe663 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f" status: 200 len: 1371 microversion: 2.1 time: 0.182040 Jun 16 19:02:04.095102 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 174/325] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:03 2022] GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f => generated 1371 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:02:04.324705 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-471fa399-423f-415d-8795-b629d14c3836 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:04.325323 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-471fa399-423f-415d-8795-b629d14c3836 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] [instance: edce90bf-b3d6-49de-a45f-9b65e1759b51] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:04.333079 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-471fa399-423f-415d-8795-b629d14c3836 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:04.333522 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-471fa399-423f-415d-8795-b629d14c3836 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:04.334285 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-471fa399-423f-415d-8795-b629d14c3836 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:04.334739 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-471fa399-423f-415d-8795-b629d14c3836 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:04.478479 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-471fa399-423f-415d-8795-b629d14c3836 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047e841cefdd4975947b2c154412953b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741ee13164894b49be1a0fc6c1385a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:04.489738 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-471fa399-423f-415d-8795-b629d14c3836 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] 10.222.0.70 "GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51" status: 200 len: 1359 microversion: 2.1 time: 0.168989 Jun 16 19:02:04.500304 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 175/326] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:04 2022] GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51 => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:02:04.521327 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.network.neutron [None req-9fb9bc4c-b56d-48c3-a6b1-fdffca57fb5f tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] validate_networks() for None {{(pid=117850) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:02:04.567493 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-e075436c-bd7e-47ab-a4ad-9196c3d20b1b tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:04.568257 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-e075436c-bd7e-47ab-a4ad-9196c3d20b1b tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:04.575665 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-e075436c-bd7e-47ab-a4ad-9196c3d20b1b tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:04.575665 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-e075436c-bd7e-47ab-a4ad-9196c3d20b1b tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:04.576412 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-e075436c-bd7e-47ab-a4ad-9196c3d20b1b tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:04.576927 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-e075436c-bd7e-47ab-a4ad-9196c3d20b1b tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:04.730971 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-e075436c-bd7e-47ab-a4ad-9196c3d20b1b tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:04.739534 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-e075436c-bd7e-47ab-a4ad-9196c3d20b1b tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:04.741153 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-e075436c-bd7e-47ab-a4ad-9196c3d20b1b tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:04.742425 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-e075436c-bd7e-47ab-a4ad-9196c3d20b1b tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1739 microversion: 2.20 time: 0.178909 Jun 16 19:02:04.743777 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 176/327] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:04 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1739 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:02:04.766712 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-fffd67bf-6b86-40af-97b5-264550a04479 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:04.767519 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-fffd67bf-6b86-40af-97b5-264550a04479 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:04.774639 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-fffd67bf-6b86-40af-97b5-264550a04479 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:04.775097 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-fffd67bf-6b86-40af-97b5-264550a04479 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:04.776180 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-fffd67bf-6b86-40af-97b5-264550a04479 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:04.776612 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-fffd67bf-6b86-40af-97b5-264550a04479 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:04.855104 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-9fb9bc4c-b56d-48c3-a6b1-fdffca57fb5f tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Flavor limits 0:0:0 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:02:04.856021 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-9fb9bc4c-b56d-48c3-a6b1-fdffca57fb5f tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Image limits 0:0:0 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:02:04.856706 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-9fb9bc4c-b56d-48c3-a6b1-fdffca57fb5f tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Flavor pref 0:0:0 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:02:04.857121 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-9fb9bc4c-b56d-48c3-a6b1-fdffca57fb5f tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Image pref 0:0:0 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:02:04.857531 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-9fb9bc4c-b56d-48c3-a6b1-fdffca57fb5f tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:02:04.866418 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-9fb9bc4c-b56d-48c3-a6b1-fdffca57fb5f tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:04.866891 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-9fb9bc4c-b56d-48c3-a6b1-fdffca57fb5f tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:04.867675 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-9fb9bc4c-b56d-48c3-a6b1-fdffca57fb5f tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:04.868107 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-9fb9bc4c-b56d-48c3-a6b1-fdffca57fb5f tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:04.885793 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.quota [None req-9fb9bc4c-b56d-48c3-a6b1-fdffca57fb5f tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Getting quotas for project bae3331bfc29456c94e309c51cb82a9f. Resources: {'cores', 'ram', 'instances'} {{(pid=117850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:02:04.890185 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.quota [None req-9fb9bc4c-b56d-48c3-a6b1-fdffca57fb5f tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Getting quotas for user 7e66f41aa3194667bd5970337fd41cfa and project bae3331bfc29456c94e309c51cb82a9f. Resources: {'cores', 'ram', 'instances'} {{(pid=117850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:02:04.902208 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-9fb9bc4c-b56d-48c3-a6b1-fdffca57fb5f tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Going to run 1 instances... {{(pid=117850) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:02:04.904879 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-9fb9bc4c-b56d-48c3-a6b1-fdffca57fb5f tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] [instance: 776433f8-bf60-4dc3-a880-ca4852e0efb6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1d993e69-7f01-4fe0-ba52-0eae2fa43ddf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:02:04.930990 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-fffd67bf-6b86-40af-97b5-264550a04479 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:04.939656 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-fffd67bf-6b86-40af-97b5-264550a04479 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1722 microversion: 2.1 time: 0.178052 Jun 16 19:02:04.940227 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 177/328] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:04 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:02:04.949632 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-9fb9bc4c-b56d-48c3-a6b1-fdffca57fb5f tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.415941 Jun 16 19:02:04.950561 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 152/329] 10.222.0.70 () {60 vars in 1146 bytes} [Thu Jun 16 19:01:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 5418 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:02:04.960308 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-44ca294d-ea04-46bf-8e69-2a4ae7bf2db3 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:04.961129 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-44ca294d-ea04-46bf-8e69-2a4ae7bf2db3 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] [instance: 776433f8-bf60-4dc3-a880-ca4852e0efb6] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:05.017789 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-44ca294d-ea04-46bf-8e69-2a4ae7bf2db3 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e66f41aa3194667bd5970337fd41cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae3331bfc29456c94e309c51cb82a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:05.024915 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-44ca294d-ea04-46bf-8e69-2a4ae7bf2db3 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] 10.222.0.70 "GET /compute/v2.1/servers/776433f8-bf60-4dc3-a880-ca4852e0efb6" status: 200 len: 1214 microversion: 2.1 time: 0.068411 Jun 16 19:02:05.025475 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 178/330] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:04 2022] GET /compute/v2.1/servers/776433f8-bf60-4dc3-a880-ca4852e0efb6 => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:05.111510 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-763aa10f-a59e-4a53-981c-961598f61cf4 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:05.112133 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-763aa10f-a59e-4a53-981c-961598f61cf4 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:05.118879 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-763aa10f-a59e-4a53-981c-961598f61cf4 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:05.119338 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-763aa10f-a59e-4a53-981c-961598f61cf4 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:05.120253 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-763aa10f-a59e-4a53-981c-961598f61cf4 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:05.120697 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-763aa10f-a59e-4a53-981c-961598f61cf4 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:05.274179 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-763aa10f-a59e-4a53-981c-961598f61cf4 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:05.283702 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-763aa10f-a59e-4a53-981c-961598f61cf4 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f" status: 200 len: 1371 microversion: 2.1 time: 0.175933 Jun 16 19:02:05.284416 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 153/331] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:05 2022] GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f => generated 1371 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:05.507391 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-bcf63d5c-4beb-4ba0-8591-70e54e75b5ca tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:05.508001 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-bcf63d5c-4beb-4ba0-8591-70e54e75b5ca tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] [instance: edce90bf-b3d6-49de-a45f-9b65e1759b51] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:05.515232 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-bcf63d5c-4beb-4ba0-8591-70e54e75b5ca tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:05.515673 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-bcf63d5c-4beb-4ba0-8591-70e54e75b5ca tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:05.516425 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-bcf63d5c-4beb-4ba0-8591-70e54e75b5ca tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:05.516852 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-bcf63d5c-4beb-4ba0-8591-70e54e75b5ca tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:05.676602 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-bcf63d5c-4beb-4ba0-8591-70e54e75b5ca tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047e841cefdd4975947b2c154412953b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741ee13164894b49be1a0fc6c1385a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:05.688317 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-bcf63d5c-4beb-4ba0-8591-70e54e75b5ca tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] 10.222.0.70 "GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51" status: 200 len: 1359 microversion: 2.1 time: 0.184584 Jun 16 19:02:05.689000 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 179/332] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:05 2022] GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51 => generated 1359 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:05.761877 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-9b145d11-b38c-43ba-bd69-998cb7c413e3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:05.763174 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-9b145d11-b38c-43ba-bd69-998cb7c413e3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:05.771172 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-9b145d11-b38c-43ba-bd69-998cb7c413e3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:05.771635 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-9b145d11-b38c-43ba-bd69-998cb7c413e3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:05.772414 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-9b145d11-b38c-43ba-bd69-998cb7c413e3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:05.774840 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-9b145d11-b38c-43ba-bd69-998cb7c413e3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:05.858536 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [req-d9d53bf2-d183-49f3-9d23-f568243fdbf0 req-aed20c0a-c204-49d0-8a65-cd7e59d76a45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdd6d861-ef2f-4b74-ba61-41178438391f", "name": "network-vif-plugged", "status": "completed", "tag": "1ac6c4c7-65ae-4602-b8de-8ddcba59c0e5"}, {"server_uuid": "1c077a29-12e0-48af-a8b6-43d0b5a79bf4", "name": "network-vif-plugged", "status": "completed", "tag": "3e9e841e-467e-4321-a3d7-1999929bc359"}]} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:02:05.869367 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-d9d53bf2-d183-49f3-9d23-f568243fdbf0 req-aed20c0a-c204-49d0-8a65-cd7e59d76a45 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:05.869825 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-d9d53bf2-d183-49f3-9d23-f568243fdbf0 req-aed20c0a-c204-49d0-8a65-cd7e59d76a45 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:05.891456 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.compute.server_external_events [req-d9d53bf2-d183-49f3-9d23-f568243fdbf0 req-aed20c0a-c204-49d0-8a65-cd7e59d76a45 service nova] Creating event network-vif-plugged:1ac6c4c7-65ae-4602-b8de-8ddcba59c0e5 for instance fdd6d861-ef2f-4b74-ba61-41178438391f on hv-cinder-84617 Jun 16 19:02:05.892340 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.compute.server_external_events [req-d9d53bf2-d183-49f3-9d23-f568243fdbf0 req-aed20c0a-c204-49d0-8a65-cd7e59d76a45 service nova] Creating event network-vif-plugged:3e9e841e-467e-4321-a3d7-1999929bc359 for instance 1c077a29-12e0-48af-a8b6-43d0b5a79bf4 on hv-cinder-84617 Jun 16 19:02:05.903894 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [req-d9d53bf2-d183-49f3-9d23-f568243fdbf0 req-aed20c0a-c204-49d0-8a65-cd7e59d76a45 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.075201 Jun 16 19:02:05.905829 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 180/333] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:02:05 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:02:05.965166 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-47d06026-d67f-4bdd-8ffe-a6eba170b0ab tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:05.966168 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-47d06026-d67f-4bdd-8ffe-a6eba170b0ab tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:05.982637 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-47d06026-d67f-4bdd-8ffe-a6eba170b0ab tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:05.983384 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-47d06026-d67f-4bdd-8ffe-a6eba170b0ab tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:05.984363 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-47d06026-d67f-4bdd-8ffe-a6eba170b0ab tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:05.984970 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-47d06026-d67f-4bdd-8ffe-a6eba170b0ab tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:06.028546 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-9b145d11-b38c-43ba-bd69-998cb7c413e3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:06.040067 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-9b145d11-b38c-43ba-bd69-998cb7c413e3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:06.042291 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-9b145d11-b38c-43ba-bd69-998cb7c413e3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:06.043705 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-9b145d11-b38c-43ba-bd69-998cb7c413e3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1739 microversion: 2.20 time: 0.286342 Jun 16 19:02:06.044564 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 154/334] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:05 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1739 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:02:06.049404 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-b494eec4-8914-48b9-9dd5-2ce600669f27 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:06.050207 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-b494eec4-8914-48b9-9dd5-2ce600669f27 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] [instance: 776433f8-bf60-4dc3-a880-ca4852e0efb6] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:06.056915 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b494eec4-8914-48b9-9dd5-2ce600669f27 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:06.057761 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b494eec4-8914-48b9-9dd5-2ce600669f27 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:06.059007 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b494eec4-8914-48b9-9dd5-2ce600669f27 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:06.059715 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b494eec4-8914-48b9-9dd5-2ce600669f27 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:06.134160 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-b494eec4-8914-48b9-9dd5-2ce600669f27 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e66f41aa3194667bd5970337fd41cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae3331bfc29456c94e309c51cb82a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:06.145562 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-b494eec4-8914-48b9-9dd5-2ce600669f27 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] 10.222.0.70 "GET /compute/v2.1/servers/776433f8-bf60-4dc3-a880-ca4852e0efb6" status: 200 len: 1266 microversion: 2.1 time: 0.099678 Jun 16 19:02:06.146215 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 155/335] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:06 2022] GET /compute/v2.1/servers/776433f8-bf60-4dc3-a880-ca4852e0efb6 => generated 1266 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:06.161559 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-47d06026-d67f-4bdd-8ffe-a6eba170b0ab tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:06.171063 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-47d06026-d67f-4bdd-8ffe-a6eba170b0ab tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1722 microversion: 2.1 time: 0.217483 Jun 16 19:02:06.171942 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 181/336] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:05 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1722 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:02:06.300096 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-48a63bbf-7a74-4738-b185-7b3b50ecd5a3 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:06.300718 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-48a63bbf-7a74-4738-b185-7b3b50ecd5a3 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:06.308122 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-48a63bbf-7a74-4738-b185-7b3b50ecd5a3 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:06.308855 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-48a63bbf-7a74-4738-b185-7b3b50ecd5a3 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:06.310504 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-48a63bbf-7a74-4738-b185-7b3b50ecd5a3 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:06.311001 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-48a63bbf-7a74-4738-b185-7b3b50ecd5a3 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:06.516942 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-48a63bbf-7a74-4738-b185-7b3b50ecd5a3 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:06.528677 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-48a63bbf-7a74-4738-b185-7b3b50ecd5a3 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f" status: 200 len: 1371 microversion: 2.1 time: 0.232293 Jun 16 19:02:06.541845 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 156/337] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:06 2022] GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f => generated 1371 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:06.707388 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-a23d9ea6-3f06-45b6-939e-48d9598d82a7 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:06.708331 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-a23d9ea6-3f06-45b6-939e-48d9598d82a7 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] [instance: edce90bf-b3d6-49de-a45f-9b65e1759b51] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:06.716827 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-a23d9ea6-3f06-45b6-939e-48d9598d82a7 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:06.717421 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-a23d9ea6-3f06-45b6-939e-48d9598d82a7 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:06.718375 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-a23d9ea6-3f06-45b6-939e-48d9598d82a7 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:06.719039 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-a23d9ea6-3f06-45b6-939e-48d9598d82a7 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:06.892026 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-a23d9ea6-3f06-45b6-939e-48d9598d82a7 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047e841cefdd4975947b2c154412953b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741ee13164894b49be1a0fc6c1385a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:06.903389 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-a23d9ea6-3f06-45b6-939e-48d9598d82a7 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] 10.222.0.70 "GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51" status: 200 len: 1549 microversion: 2.1 time: 0.201234 Jun 16 19:02:06.910857 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 182/338] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:06 2022] GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51 => generated 1549 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:06.929103 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-d3f3274b-fc4e-4e57-a781-936209d961f3 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:06.930626 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-d3f3274b-fc4e-4e57-a781-936209d961f3 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] [instance: edce90bf-b3d6-49de-a45f-9b65e1759b51] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:06.952730 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d3f3274b-fc4e-4e57-a781-936209d961f3 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:06.953303 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d3f3274b-fc4e-4e57-a781-936209d961f3 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:06.957376 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d3f3274b-fc4e-4e57-a781-936209d961f3 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:06.961638 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d3f3274b-fc4e-4e57-a781-936209d961f3 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:07.068816 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-978bc988-e795-4222-8715-1daadc734e9d tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:07.069434 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-978bc988-e795-4222-8715-1daadc734e9d tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:07.083451 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-978bc988-e795-4222-8715-1daadc734e9d tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:07.084526 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-978bc988-e795-4222-8715-1daadc734e9d tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:07.089634 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-978bc988-e795-4222-8715-1daadc734e9d tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:07.090598 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-978bc988-e795-4222-8715-1daadc734e9d tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:07.192677 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-d3f3274b-fc4e-4e57-a781-936209d961f3 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047e841cefdd4975947b2c154412953b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741ee13164894b49be1a0fc6c1385a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:07.205790 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-d3f3274b-fc4e-4e57-a781-936209d961f3 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] 10.222.0.70 "GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51" status: 200 len: 1549 microversion: 2.1 time: 0.280910 Jun 16 19:02:07.207020 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 157/339] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:06 2022] GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51 => generated 1549 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:02:07.214472 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-69d5d481-45ad-4013-8e0d-9ece9bd190c7 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:07.215567 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-69d5d481-45ad-4013-8e0d-9ece9bd190c7 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] [instance: 776433f8-bf60-4dc3-a880-ca4852e0efb6] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:07.223046 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-69d5d481-45ad-4013-8e0d-9ece9bd190c7 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:07.223763 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-69d5d481-45ad-4013-8e0d-9ece9bd190c7 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:07.224528 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-69d5d481-45ad-4013-8e0d-9ece9bd190c7 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:07.225128 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-69d5d481-45ad-4013-8e0d-9ece9bd190c7 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:07.331768 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-69d5d481-45ad-4013-8e0d-9ece9bd190c7 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e66f41aa3194667bd5970337fd41cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae3331bfc29456c94e309c51cb82a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:07.348756 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-69d5d481-45ad-4013-8e0d-9ece9bd190c7 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] 10.222.0.70 "GET /compute/v2.1/servers/776433f8-bf60-4dc3-a880-ca4852e0efb6" status: 200 len: 1274 microversion: 2.1 time: 0.140308 Jun 16 19:02:07.363824 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 158/340] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:07 2022] GET /compute/v2.1/servers/776433f8-bf60-4dc3-a880-ca4852e0efb6 => generated 1274 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:07.373068 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-17b75f67-e8bc-422b-be01-7f67754ee25e tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:07.390439 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-17b75f67-e8bc-422b-be01-7f67754ee25e tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:07.398564 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-17b75f67-e8bc-422b-be01-7f67754ee25e tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:07.399032 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-17b75f67-e8bc-422b-be01-7f67754ee25e tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:07.399821 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-17b75f67-e8bc-422b-be01-7f67754ee25e tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:07.400262 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-17b75f67-e8bc-422b-be01-7f67754ee25e tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:07.675294 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-17b75f67-e8bc-422b-be01-7f67754ee25e tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:07.723178 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-17b75f67-e8bc-422b-be01-7f67754ee25e tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1722 microversion: 2.1 time: 0.357506 Jun 16 19:02:07.723793 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 159/341] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:07 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1722 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:07.731127 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-8e680268-133b-451b-a8c8-c82ef865d22c tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:07.747224 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-8e680268-133b-451b-a8c8-c82ef865d22c tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '047e841cefdd4975947b2c154412953b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741ee13164894b49be1a0fc6c1385a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:07.748063 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-8e680268-133b-451b-a8c8-c82ef865d22c tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Searching by: {'deleted': False, 'project_id': '741ee13164894b49be1a0fc6c1385a8e'} {{(pid=117850) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 19:02:07.761687 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-978bc988-e795-4222-8715-1daadc734e9d tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:07.766951 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-8e680268-133b-451b-a8c8-c82ef865d22c tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:07.767404 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-8e680268-133b-451b-a8c8-c82ef865d22c tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:07.768193 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-8e680268-133b-451b-a8c8-c82ef865d22c tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:07.768623 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-8e680268-133b-451b-a8c8-c82ef865d22c tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:07.774165 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-978bc988-e795-4222-8715-1daadc734e9d tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:07.778215 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-978bc988-e795-4222-8715-1daadc734e9d tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:07.780240 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-978bc988-e795-4222-8715-1daadc734e9d tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1739 microversion: 2.20 time: 0.715483 Jun 16 19:02:07.781361 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 183/342] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:07 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1739 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:02:07.787005 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-a30b8e4e-3f8b-497c-a674-cec8eb82f446 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:07.788226 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-a30b8e4e-3f8b-497c-a674-cec8eb82f446 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:07.800739 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-a30b8e4e-3f8b-497c-a674-cec8eb82f446 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:07.801638 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-a30b8e4e-3f8b-497c-a674-cec8eb82f446 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:07.802805 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-a30b8e4e-3f8b-497c-a674-cec8eb82f446 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:07.803480 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-a30b8e4e-3f8b-497c-a674-cec8eb82f446 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:07.826327 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_cell1:SELECT=100 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:02:07.888754 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.multi_cell_list [None req-8e680268-133b-451b-a8c8-c82ef865d22c tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117850) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 16 19:02:07.987573 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-a30b8e4e-3f8b-497c-a674-cec8eb82f446 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:07.997848 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-a30b8e4e-3f8b-497c-a674-cec8eb82f446 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f" status: 200 len: 1371 microversion: 2.1 time: 0.215147 Jun 16 19:02:07.998642 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 184/343] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:07 2022] GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f => generated 1371 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:08.003754 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-8e680268-133b-451b-a8c8-c82ef865d22c tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] 10.222.0.70 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.278518 Jun 16 19:02:08.004315 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 160/344] 10.222.0.70 () {58 vars in 1124 bytes} [Thu Jun 16 19:02:07 2022] GET /compute/v2.1/servers => generated 343 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:02:08.018961 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-1b81cdb7-64f3-4048-880a-11e99140fbe5 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:08.019854 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-1b81cdb7-64f3-4048-880a-11e99140fbe5 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] [instance: edce90bf-b3d6-49de-a45f-9b65e1759b51] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:08.040714 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-1b81cdb7-64f3-4048-880a-11e99140fbe5 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:08.041161 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-1b81cdb7-64f3-4048-880a-11e99140fbe5 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:08.041998 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-1b81cdb7-64f3-4048-880a-11e99140fbe5 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:08.042712 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-1b81cdb7-64f3-4048-880a-11e99140fbe5 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:08.272769 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-1b81cdb7-64f3-4048-880a-11e99140fbe5 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047e841cefdd4975947b2c154412953b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741ee13164894b49be1a0fc6c1385a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:08.283362 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-1b81cdb7-64f3-4048-880a-11e99140fbe5 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] 10.222.0.70 "GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51" status: 200 len: 1549 microversion: 2.1 time: 0.268459 Jun 16 19:02:08.285130 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 185/345] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:08 2022] GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51 => generated 1549 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:08.367480 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-b31ff805-e6b1-41c1-8562-e3d272872796 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:08.368411 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-b31ff805-e6b1-41c1-8562-e3d272872796 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] [instance: 776433f8-bf60-4dc3-a880-ca4852e0efb6] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:08.375493 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b31ff805-e6b1-41c1-8562-e3d272872796 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:08.378163 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b31ff805-e6b1-41c1-8562-e3d272872796 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:08.382105 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b31ff805-e6b1-41c1-8562-e3d272872796 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:08.383039 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b31ff805-e6b1-41c1-8562-e3d272872796 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:08.507184 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-b31ff805-e6b1-41c1-8562-e3d272872796 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e66f41aa3194667bd5970337fd41cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae3331bfc29456c94e309c51cb82a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:08.520569 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-b31ff805-e6b1-41c1-8562-e3d272872796 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] 10.222.0.70 "GET /compute/v2.1/servers/776433f8-bf60-4dc3-a880-ca4852e0efb6" status: 200 len: 1272 microversion: 2.1 time: 0.156594 Jun 16 19:02:08.533758 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 161/346] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:08 2022] GET /compute/v2.1/servers/776433f8-bf60-4dc3-a880-ca4852e0efb6 => generated 1272 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:08.741801 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-cd55789a-c8d9-4cfd-ad6e-f7f5eb136312 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:08.742694 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-cd55789a-c8d9-4cfd-ad6e-f7f5eb136312 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:08.752579 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-cd55789a-c8d9-4cfd-ad6e-f7f5eb136312 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:08.754583 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-cd55789a-c8d9-4cfd-ad6e-f7f5eb136312 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:08.759410 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-cd55789a-c8d9-4cfd-ad6e-f7f5eb136312 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:08.760115 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-cd55789a-c8d9-4cfd-ad6e-f7f5eb136312 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:08.800014 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-59500c5d-9c6e-4c26-bd07-d280a11ff8d5 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:08.801046 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-59500c5d-9c6e-4c26-bd07-d280a11ff8d5 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:08.810008 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-59500c5d-9c6e-4c26-bd07-d280a11ff8d5 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:08.810450 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-59500c5d-9c6e-4c26-bd07-d280a11ff8d5 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:08.818710 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-59500c5d-9c6e-4c26-bd07-d280a11ff8d5 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:08.819149 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-59500c5d-9c6e-4c26-bd07-d280a11ff8d5 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:09.171760 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-59500c5d-9c6e-4c26-bd07-d280a11ff8d5 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:09.181371 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-59500c5d-9c6e-4c26-bd07-d280a11ff8d5 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:09.191344 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-cd55789a-c8d9-4cfd-ad6e-f7f5eb136312 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:09.192552 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-59500c5d-9c6e-4c26-bd07-d280a11ff8d5 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:09.194014 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-59500c5d-9c6e-4c26-bd07-d280a11ff8d5 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1739 microversion: 2.20 time: 0.398312 Jun 16 19:02:09.201086 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-cd55789a-c8d9-4cfd-ad6e-f7f5eb136312 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1722 microversion: 2.1 time: 0.463374 Jun 16 19:02:09.201655 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 186/347] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:08 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1722 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:09.202233 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 162/348] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:08 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1739 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:02:09.207321 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-486ff5ae-f1a7-464a-94fa-cab6f6abd0f9 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:09.207937 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-486ff5ae-f1a7-464a-94fa-cab6f6abd0f9 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:09.220496 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-486ff5ae-f1a7-464a-94fa-cab6f6abd0f9 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:09.220953 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-486ff5ae-f1a7-464a-94fa-cab6f6abd0f9 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:09.221732 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-486ff5ae-f1a7-464a-94fa-cab6f6abd0f9 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:09.222162 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-486ff5ae-f1a7-464a-94fa-cab6f6abd0f9 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:09.525458 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-486ff5ae-f1a7-464a-94fa-cab6f6abd0f9 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:09.539190 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-36325dd3-ec09-4c57-a2db-96c7eccbadc7 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:09.547276 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-36325dd3-ec09-4c57-a2db-96c7eccbadc7 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] [instance: 776433f8-bf60-4dc3-a880-ca4852e0efb6] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:09.548717 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-486ff5ae-f1a7-464a-94fa-cab6f6abd0f9 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f" status: 200 len: 1371 microversion: 2.1 time: 0.342824 Jun 16 19:02:09.549820 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 163/349] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:09 2022] GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f => generated 1371 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:09.564550 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-36325dd3-ec09-4c57-a2db-96c7eccbadc7 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:09.578070 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-36325dd3-ec09-4c57-a2db-96c7eccbadc7 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:09.579326 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-36325dd3-ec09-4c57-a2db-96c7eccbadc7 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:09.579883 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-36325dd3-ec09-4c57-a2db-96c7eccbadc7 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:09.901782 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-36325dd3-ec09-4c57-a2db-96c7eccbadc7 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e66f41aa3194667bd5970337fd41cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae3331bfc29456c94e309c51cb82a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:09.914798 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-36325dd3-ec09-4c57-a2db-96c7eccbadc7 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] 10.222.0.70 "GET /compute/v2.1/servers/776433f8-bf60-4dc3-a880-ca4852e0efb6" status: 200 len: 1314 microversion: 2.1 time: 0.378230 Jun 16 19:02:09.916158 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 187/350] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:09 2022] GET /compute/v2.1/servers/776433f8-bf60-4dc3-a880-ca4852e0efb6 => generated 1314 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:02:10.217144 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-e029e57b-ccfc-48d7-9d8a-b320bf047667 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c5a2cd30-9742-4190-866d-9274217cfc27"}} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:02:10.219974 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-81222261-ba52-4e48-a18b-c09c344ef01a tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:10.220828 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-e029e57b-ccfc-48d7-9d8a-b320bf047667 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] [instance: edce90bf-b3d6-49de-a45f-9b65e1759b51] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:10.220955 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-81222261-ba52-4e48-a18b-c09c344ef01a tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:10.227556 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-e029e57b-ccfc-48d7-9d8a-b320bf047667 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:10.228057 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-e029e57b-ccfc-48d7-9d8a-b320bf047667 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:10.228827 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-e029e57b-ccfc-48d7-9d8a-b320bf047667 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:10.229960 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-e029e57b-ccfc-48d7-9d8a-b320bf047667 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:10.230737 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-81222261-ba52-4e48-a18b-c09c344ef01a tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:10.231193 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-81222261-ba52-4e48-a18b-c09c344ef01a tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:10.231971 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-81222261-ba52-4e48-a18b-c09c344ef01a tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:10.232408 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-81222261-ba52-4e48-a18b-c09c344ef01a tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:10.722122 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:02:10.765220 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-e029e57b-ccfc-48d7-9d8a-b320bf047667 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] 10.222.0.70 "POST /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.556849 Jun 16 19:02:10.767527 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 164/351] 10.222.0.70 () {60 vars in 1322 bytes} [Thu Jun 16 19:02:10 2022] POST /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51/os-volume_attachments => generated 194 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:02:10.782218 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-d0003237-c9d6-4fa1-885e-11eae8679d04 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:10.783145 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-d0003237-c9d6-4fa1-885e-11eae8679d04 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:10.840319 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d0003237-c9d6-4fa1-885e-11eae8679d04 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:10.843093 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d0003237-c9d6-4fa1-885e-11eae8679d04 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:10.844034 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d0003237-c9d6-4fa1-885e-11eae8679d04 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:10.844491 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d0003237-c9d6-4fa1-885e-11eae8679d04 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:11.154797 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-81222261-ba52-4e48-a18b-c09c344ef01a tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:11.170860 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-81222261-ba52-4e48-a18b-c09c344ef01a tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1722 microversion: 2.1 time: 0.954165 Jun 16 19:02:11.182269 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 188/352] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:10 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1722 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:11.187717 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [req-c08d4d9f-bddc-43f0-88a3-f2ccaf0b6171 req-72aee786-2a0e-4752-ba56-96d7af693ac4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "776433f8-bf60-4dc3-a880-ca4852e0efb6", "tag": "69181f9d-e4b3-4213-a349-724bc82a71f6"}]} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:02:11.200648 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-c08d4d9f-bddc-43f0-88a3-f2ccaf0b6171 req-72aee786-2a0e-4752-ba56-96d7af693ac4 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:11.201088 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-c08d4d9f-bddc-43f0-88a3-f2ccaf0b6171 req-72aee786-2a0e-4752-ba56-96d7af693ac4 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:11.216581 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.compute.server_external_events [req-c08d4d9f-bddc-43f0-88a3-f2ccaf0b6171 req-72aee786-2a0e-4752-ba56-96d7af693ac4 service nova] Creating event network-changed:69181f9d-e4b3-4213-a349-724bc82a71f6 for instance 776433f8-bf60-4dc3-a880-ca4852e0efb6 on hv-cinder-84617 Jun 16 19:02:11.223485 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [req-c08d4d9f-bddc-43f0-88a3-f2ccaf0b6171 req-72aee786-2a0e-4752-ba56-96d7af693ac4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039243 Jun 16 19:02:11.224910 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 189/353] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:02:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:02:11.235787 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-a653d503-4151-4761-9dd6-c7e1484bb1c8 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:11.236840 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-a653d503-4151-4761-9dd6-c7e1484bb1c8 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:11.250982 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-a653d503-4151-4761-9dd6-c7e1484bb1c8 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:11.252051 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-a653d503-4151-4761-9dd6-c7e1484bb1c8 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:11.253166 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-a653d503-4151-4761-9dd6-c7e1484bb1c8 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:11.253914 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-a653d503-4151-4761-9dd6-c7e1484bb1c8 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:11.256575 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-d0003237-c9d6-4fa1-885e-11eae8679d04 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:11.278035 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-d0003237-c9d6-4fa1-885e-11eae8679d04 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:11.279682 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-d0003237-c9d6-4fa1-885e-11eae8679d04 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:11.292971 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-d0003237-c9d6-4fa1-885e-11eae8679d04 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1739 microversion: 2.20 time: 0.522936 Jun 16 19:02:11.293759 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 165/354] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:10 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1739 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:02:11.307948 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-0d12c49e-9d45-4e15-8974-269d75070139 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:11.308415 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-0d12c49e-9d45-4e15-8974-269d75070139 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] [instance: 776433f8-bf60-4dc3-a880-ca4852e0efb6] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:11.318109 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0d12c49e-9d45-4e15-8974-269d75070139 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:11.320647 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0d12c49e-9d45-4e15-8974-269d75070139 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:11.321677 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0d12c49e-9d45-4e15-8974-269d75070139 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:11.322120 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0d12c49e-9d45-4e15-8974-269d75070139 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:11.537219 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-0d12c49e-9d45-4e15-8974-269d75070139 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e66f41aa3194667bd5970337fd41cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae3331bfc29456c94e309c51cb82a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:11.555443 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-0d12c49e-9d45-4e15-8974-269d75070139 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] 10.222.0.70 "GET /compute/v2.1/servers/776433f8-bf60-4dc3-a880-ca4852e0efb6" status: 200 len: 1314 microversion: 2.1 time: 0.260122 Jun 16 19:02:11.565773 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 166/355] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:11 2022] GET /compute/v2.1/servers/776433f8-bf60-4dc3-a880-ca4852e0efb6 => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:11.635096 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-a653d503-4151-4761-9dd6-c7e1484bb1c8 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:11.643692 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-a653d503-4151-4761-9dd6-c7e1484bb1c8 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f" status: 200 len: 1566 microversion: 2.1 time: 0.417424 Jun 16 19:02:11.644270 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 190/356] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:11 2022] GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f => generated 1566 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:11.660641 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-6545adf8-811e-4040-9580-350c0f111c4c tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:11.661434 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-6545adf8-811e-4040-9580-350c0f111c4c tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:11.668890 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-6545adf8-811e-4040-9580-350c0f111c4c tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:11.669376 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-6545adf8-811e-4040-9580-350c0f111c4c tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:11.670271 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-6545adf8-811e-4040-9580-350c0f111c4c tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:11.670970 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-6545adf8-811e-4040-9580-350c0f111c4c tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:11.769112 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-6545adf8-811e-4040-9580-350c0f111c4c tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.112486 Jun 16 19:02:11.769689 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 167/357] 10.222.0.70 () {58 vars in 1274 bytes} [Thu Jun 16 19:02:11 2022] GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f/os-interface => generated 285 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:02:12.203571 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-673c30ef-cac4-4bd6-8105-47bef50c5668 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:12.204389 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-673c30ef-cac4-4bd6-8105-47bef50c5668 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:12.217105 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-673c30ef-cac4-4bd6-8105-47bef50c5668 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:12.217626 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-673c30ef-cac4-4bd6-8105-47bef50c5668 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:12.218396 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-673c30ef-cac4-4bd6-8105-47bef50c5668 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:12.218858 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-673c30ef-cac4-4bd6-8105-47bef50c5668 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:12.312947 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-11568b5d-7db1-4172-9822-0e31e2031232 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:12.314188 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-11568b5d-7db1-4172-9822-0e31e2031232 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:12.326289 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-11568b5d-7db1-4172-9822-0e31e2031232 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:12.327058 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-11568b5d-7db1-4172-9822-0e31e2031232 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:12.329262 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-11568b5d-7db1-4172-9822-0e31e2031232 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:12.330895 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-11568b5d-7db1-4172-9822-0e31e2031232 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:12.582019 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-11568b5d-7db1-4172-9822-0e31e2031232 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:12.593037 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-11568b5d-7db1-4172-9822-0e31e2031232 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:12.594903 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-11568b5d-7db1-4172-9822-0e31e2031232 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:12.596347 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-11568b5d-7db1-4172-9822-0e31e2031232 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1739 microversion: 2.20 time: 0.288037 Jun 16 19:02:12.596934 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 168/358] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:12 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1739 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:02:12.602637 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-5baaf9ee-7c65-4e0e-8e53-cee2380b4154 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:12.603543 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-5baaf9ee-7c65-4e0e-8e53-cee2380b4154 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] [instance: 776433f8-bf60-4dc3-a880-ca4852e0efb6] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:12.611733 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-5baaf9ee-7c65-4e0e-8e53-cee2380b4154 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:12.612486 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-5baaf9ee-7c65-4e0e-8e53-cee2380b4154 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:12.613518 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-5baaf9ee-7c65-4e0e-8e53-cee2380b4154 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:12.614213 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-5baaf9ee-7c65-4e0e-8e53-cee2380b4154 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:12.769339 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-673c30ef-cac4-4bd6-8105-47bef50c5668 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:12.779250 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-673c30ef-cac4-4bd6-8105-47bef50c5668 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1722 microversion: 2.1 time: 0.594696 Jun 16 19:02:12.779868 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-5baaf9ee-7c65-4e0e-8e53-cee2380b4154 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e66f41aa3194667bd5970337fd41cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae3331bfc29456c94e309c51cb82a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:12.780676 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 191/359] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:12 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1722 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:12.792642 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-5baaf9ee-7c65-4e0e-8e53-cee2380b4154 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] 10.222.0.70 "GET /compute/v2.1/servers/776433f8-bf60-4dc3-a880-ca4852e0efb6" status: 200 len: 1314 microversion: 2.1 time: 0.193793 Jun 16 19:02:12.793789 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 169/360] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:12 2022] GET /compute/v2.1/servers/776433f8-bf60-4dc3-a880-ca4852e0efb6 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:13.432729 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [req-97a16c72-94b8-4728-85a2-824e1fcae960 req-a075ec3a-e09f-4c0e-97fe-d5e7fcca61b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdd6d861-ef2f-4b74-ba61-41178438391f", "tag": "1ac6c4c7-65ae-4602-b8de-8ddcba59c0e5"}]} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:02:13.441330 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-97a16c72-94b8-4728-85a2-824e1fcae960 req-a075ec3a-e09f-4c0e-97fe-d5e7fcca61b3 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:13.441770 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-97a16c72-94b8-4728-85a2-824e1fcae960 req-a075ec3a-e09f-4c0e-97fe-d5e7fcca61b3 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:13.455081 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.compute.server_external_events [req-97a16c72-94b8-4728-85a2-824e1fcae960 req-a075ec3a-e09f-4c0e-97fe-d5e7fcca61b3 service nova] Creating event network-changed:1ac6c4c7-65ae-4602-b8de-8ddcba59c0e5 for instance fdd6d861-ef2f-4b74-ba61-41178438391f on hv-cinder-84617 Jun 16 19:02:13.461477 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [req-97a16c72-94b8-4728-85a2-824e1fcae960 req-a075ec3a-e09f-4c0e-97fe-d5e7fcca61b3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032381 Jun 16 19:02:13.466700 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 192/361] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:02:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:02:13.615753 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-09dc2beb-f0d5-4e82-a251-17e62302fd43 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:13.618066 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-09dc2beb-f0d5-4e82-a251-17e62302fd43 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:13.625542 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-09dc2beb-f0d5-4e82-a251-17e62302fd43 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:13.626401 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-09dc2beb-f0d5-4e82-a251-17e62302fd43 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:13.627622 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-09dc2beb-f0d5-4e82-a251-17e62302fd43 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:13.628465 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-09dc2beb-f0d5-4e82-a251-17e62302fd43 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:13.799821 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-77fb26e9-a3f6-4271-aab4-813aaf6b4690 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:13.801219 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-77fb26e9-a3f6-4271-aab4-813aaf6b4690 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:13.819354 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-77fb26e9-a3f6-4271-aab4-813aaf6b4690 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:13.820212 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-77fb26e9-a3f6-4271-aab4-813aaf6b4690 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:13.822094 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-77fb26e9-a3f6-4271-aab4-813aaf6b4690 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:13.824704 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-77fb26e9-a3f6-4271-aab4-813aaf6b4690 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:13.887916 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-09dc2beb-f0d5-4e82-a251-17e62302fd43 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:13.897117 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-09dc2beb-f0d5-4e82-a251-17e62302fd43 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:13.899029 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-09dc2beb-f0d5-4e82-a251-17e62302fd43 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:13.901427 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-09dc2beb-f0d5-4e82-a251-17e62302fd43 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1739 microversion: 2.20 time: 0.289463 Jun 16 19:02:13.902698 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 170/362] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:13 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1739 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:02:13.907637 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-f61c2b7b-33c1-4418-a9f5-46454a69eb01 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:13.908576 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-f61c2b7b-33c1-4418-a9f5-46454a69eb01 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] [instance: 776433f8-bf60-4dc3-a880-ca4852e0efb6] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:13.916607 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-f61c2b7b-33c1-4418-a9f5-46454a69eb01 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:13.917318 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-f61c2b7b-33c1-4418-a9f5-46454a69eb01 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:13.919211 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-f61c2b7b-33c1-4418-a9f5-46454a69eb01 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:13.921046 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-f61c2b7b-33c1-4418-a9f5-46454a69eb01 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:14.017391 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-77fb26e9-a3f6-4271-aab4-813aaf6b4690 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:14.031996 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-77fb26e9-a3f6-4271-aab4-813aaf6b4690 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1722 microversion: 2.1 time: 0.236879 Jun 16 19:02:14.033899 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 193/363] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:13 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1722 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:14.125501 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-f61c2b7b-33c1-4418-a9f5-46454a69eb01 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e66f41aa3194667bd5970337fd41cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae3331bfc29456c94e309c51cb82a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:14.137027 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-f61c2b7b-33c1-4418-a9f5-46454a69eb01 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] 10.222.0.70 "GET /compute/v2.1/servers/776433f8-bf60-4dc3-a880-ca4852e0efb6" status: 200 len: 1314 microversion: 2.1 time: 0.232996 Jun 16 19:02:14.139714 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 171/364] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:13 2022] GET /compute/v2.1/servers/776433f8-bf60-4dc3-a880-ca4852e0efb6 => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:14.921576 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-51a5fcce-ce55-4529-9796-91de220e5169 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:14.922213 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-51a5fcce-ce55-4529-9796-91de220e5169 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:14.945343 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-51a5fcce-ce55-4529-9796-91de220e5169 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:14.946225 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-51a5fcce-ce55-4529-9796-91de220e5169 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:14.947257 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-51a5fcce-ce55-4529-9796-91de220e5169 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:14.948160 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-51a5fcce-ce55-4529-9796-91de220e5169 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:15.022412 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_cell0:SELECT=2 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:02:15.052326 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-8dcb1d6c-13b1-4d08-9bf8-eb97e579b88c tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:15.053207 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-8dcb1d6c-13b1-4d08-9bf8-eb97e579b88c tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:15.061553 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_cell0:SELECT=6 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:02:15.076198 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-8dcb1d6c-13b1-4d08-9bf8-eb97e579b88c tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:15.076329 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-8dcb1d6c-13b1-4d08-9bf8-eb97e579b88c tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:15.077187 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-8dcb1d6c-13b1-4d08-9bf8-eb97e579b88c tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:15.086490 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-8dcb1d6c-13b1-4d08-9bf8-eb97e579b88c tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:15.350515 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-51a5fcce-ce55-4529-9796-91de220e5169 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:15.367305 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-51a5fcce-ce55-4529-9796-91de220e5169 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:15.369939 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-51a5fcce-ce55-4529-9796-91de220e5169 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:15.371578 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-51a5fcce-ce55-4529-9796-91de220e5169 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1739 microversion: 2.20 time: 0.455264 Jun 16 19:02:15.388103 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 194/365] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:14 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1739 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:02:15.398815 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-8796d078-077a-4487-ab18-9715ecf5c94d tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:15.404224 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-8796d078-077a-4487-ab18-9715ecf5c94d tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] [instance: 776433f8-bf60-4dc3-a880-ca4852e0efb6] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:15.411406 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-8796d078-077a-4487-ab18-9715ecf5c94d tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:15.412758 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-8796d078-077a-4487-ab18-9715ecf5c94d tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:15.413710 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-8796d078-077a-4487-ab18-9715ecf5c94d tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:15.414313 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-8796d078-077a-4487-ab18-9715ecf5c94d tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:15.429691 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-8dcb1d6c-13b1-4d08-9bf8-eb97e579b88c tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:15.451650 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-8dcb1d6c-13b1-4d08-9bf8-eb97e579b88c tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1722 microversion: 2.1 time: 0.401462 Jun 16 19:02:15.452873 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 172/366] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:15 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1722 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:02:15.655277 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-8796d078-077a-4487-ab18-9715ecf5c94d tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e66f41aa3194667bd5970337fd41cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae3331bfc29456c94e309c51cb82a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:15.670483 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-8796d078-077a-4487-ab18-9715ecf5c94d tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] 10.222.0.70 "GET /compute/v2.1/servers/776433f8-bf60-4dc3-a880-ca4852e0efb6" status: 200 len: 1314 microversion: 2.1 time: 0.281185 Jun 16 19:02:15.682961 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 195/367] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:15 2022] GET /compute/v2.1/servers/776433f8-bf60-4dc3-a880-ca4852e0efb6 => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:16.390939 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-42af14f7-45b4-498f-a47d-0f080adb05d1 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:16.391674 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-42af14f7-45b4-498f-a47d-0f080adb05d1 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:16.403120 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-42af14f7-45b4-498f-a47d-0f080adb05d1 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:16.403839 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-42af14f7-45b4-498f-a47d-0f080adb05d1 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:16.404808 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-42af14f7-45b4-498f-a47d-0f080adb05d1 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:16.405240 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-42af14f7-45b4-498f-a47d-0f080adb05d1 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:16.471470 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-97b4f24e-5835-412b-8daf-1bc7d2345c21 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:16.473272 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-97b4f24e-5835-412b-8daf-1bc7d2345c21 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:16.480048 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_api:SELECT=100 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:02:16.483228 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-97b4f24e-5835-412b-8daf-1bc7d2345c21 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:16.484313 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-97b4f24e-5835-412b-8daf-1bc7d2345c21 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:16.485390 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-97b4f24e-5835-412b-8daf-1bc7d2345c21 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:16.486358 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-97b4f24e-5835-412b-8daf-1bc7d2345c21 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:16.577950 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-42af14f7-45b4-498f-a47d-0f080adb05d1 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:16.602699 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-42af14f7-45b4-498f-a47d-0f080adb05d1 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:16.606098 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-42af14f7-45b4-498f-a47d-0f080adb05d1 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:16.614212 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-42af14f7-45b4-498f-a47d-0f080adb05d1 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1739 microversion: 2.20 time: 0.227222 Jun 16 19:02:16.619589 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 173/368] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:16 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1739 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:02:16.688604 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-5428de82-de12-406c-ae56-d4c8b0729155 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:16.689421 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-5428de82-de12-406c-ae56-d4c8b0729155 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] [instance: 776433f8-bf60-4dc3-a880-ca4852e0efb6] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:16.697201 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-5428de82-de12-406c-ae56-d4c8b0729155 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:16.700183 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-5428de82-de12-406c-ae56-d4c8b0729155 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:16.701119 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-5428de82-de12-406c-ae56-d4c8b0729155 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:16.701826 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-5428de82-de12-406c-ae56-d4c8b0729155 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:16.750883 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-97b4f24e-5835-412b-8daf-1bc7d2345c21 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:16.766855 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-97b4f24e-5835-412b-8daf-1bc7d2345c21 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1722 microversion: 2.1 time: 0.300076 Jun 16 19:02:16.774986 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 196/369] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:16 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1722 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:16.921204 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-5428de82-de12-406c-ae56-d4c8b0729155 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e66f41aa3194667bd5970337fd41cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae3331bfc29456c94e309c51cb82a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:16.931026 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-5428de82-de12-406c-ae56-d4c8b0729155 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] 10.222.0.70 "GET /compute/v2.1/servers/776433f8-bf60-4dc3-a880-ca4852e0efb6" status: 200 len: 1314 microversion: 2.1 time: 0.246789 Jun 16 19:02:16.932329 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 174/370] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:16 2022] GET /compute/v2.1/servers/776433f8-bf60-4dc3-a880-ca4852e0efb6 => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:17.639996 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-d9c49e9e-1ce1-4bed-8e0f-ac6d7211b1a8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:17.640743 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-d9c49e9e-1ce1-4bed-8e0f-ac6d7211b1a8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:17.647764 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d9c49e9e-1ce1-4bed-8e0f-ac6d7211b1a8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:17.648429 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d9c49e9e-1ce1-4bed-8e0f-ac6d7211b1a8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:17.649447 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d9c49e9e-1ce1-4bed-8e0f-ac6d7211b1a8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:17.653065 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d9c49e9e-1ce1-4bed-8e0f-ac6d7211b1a8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:17.784635 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-c007e31f-9d49-4229-be51-6beb4b745cfc tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:17.785223 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-c007e31f-9d49-4229-be51-6beb4b745cfc tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:17.795572 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-c007e31f-9d49-4229-be51-6beb4b745cfc tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:17.796111 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-c007e31f-9d49-4229-be51-6beb4b745cfc tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:17.796950 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-c007e31f-9d49-4229-be51-6beb4b745cfc tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:17.797627 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-c007e31f-9d49-4229-be51-6beb4b745cfc tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:17.819317 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_cell0:SELECT=4 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:02:17.839730 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-d9c49e9e-1ce1-4bed-8e0f-ac6d7211b1a8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:17.854600 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-d9c49e9e-1ce1-4bed-8e0f-ac6d7211b1a8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:17.854600 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-d9c49e9e-1ce1-4bed-8e0f-ac6d7211b1a8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:17.854600 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-d9c49e9e-1ce1-4bed-8e0f-ac6d7211b1a8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1739 microversion: 2.20 time: 0.215352 Jun 16 19:02:17.856131 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 197/371] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:17 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1739 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:02:17.952762 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-ab95414a-19d2-4a24-b70d-a1a14dda9fe4 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:17.953398 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-ab95414a-19d2-4a24-b70d-a1a14dda9fe4 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] [instance: 776433f8-bf60-4dc3-a880-ca4852e0efb6] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:17.960653 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ab95414a-19d2-4a24-b70d-a1a14dda9fe4 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:17.960653 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ab95414a-19d2-4a24-b70d-a1a14dda9fe4 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:17.961404 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ab95414a-19d2-4a24-b70d-a1a14dda9fe4 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:17.961833 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ab95414a-19d2-4a24-b70d-a1a14dda9fe4 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:17.998281 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-c007e31f-9d49-4229-be51-6beb4b745cfc tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:18.007213 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-c007e31f-9d49-4229-be51-6beb4b745cfc tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1722 microversion: 2.1 time: 0.226260 Jun 16 19:02:18.008254 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 175/372] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:17 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1722 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:02:18.118941 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-ab95414a-19d2-4a24-b70d-a1a14dda9fe4 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e66f41aa3194667bd5970337fd41cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae3331bfc29456c94e309c51cb82a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:18.127313 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-ab95414a-19d2-4a24-b70d-a1a14dda9fe4 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] 10.222.0.70 "GET /compute/v2.1/servers/776433f8-bf60-4dc3-a880-ca4852e0efb6" status: 200 len: 1314 microversion: 2.1 time: 0.179826 Jun 16 19:02:18.127874 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 198/373] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:17 2022] GET /compute/v2.1/servers/776433f8-bf60-4dc3-a880-ca4852e0efb6 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:02:18.871680 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-13dc36f2-d228-4059-8dd6-eb6609988800 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:18.872299 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-13dc36f2-d228-4059-8dd6-eb6609988800 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:18.879203 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-13dc36f2-d228-4059-8dd6-eb6609988800 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:18.879655 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-13dc36f2-d228-4059-8dd6-eb6609988800 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:18.880413 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-13dc36f2-d228-4059-8dd6-eb6609988800 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:18.880853 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-13dc36f2-d228-4059-8dd6-eb6609988800 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:19.011697 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-13dc36f2-d228-4059-8dd6-eb6609988800 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:19.019631 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-13dc36f2-d228-4059-8dd6-eb6609988800 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:19.021219 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-13dc36f2-d228-4059-8dd6-eb6609988800 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:19.022389 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-13dc36f2-d228-4059-8dd6-eb6609988800 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1739 microversion: 2.20 time: 0.154977 Jun 16 19:02:19.022979 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 176/374] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:18 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1739 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:02:19.025327 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-dae0120b-5ff5-439e-bfab-69f312e69324 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:19.027033 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-dae0120b-5ff5-439e-bfab-69f312e69324 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:19.033486 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-dae0120b-5ff5-439e-bfab-69f312e69324 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:19.033928 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-dae0120b-5ff5-439e-bfab-69f312e69324 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:19.034712 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-dae0120b-5ff5-439e-bfab-69f312e69324 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:19.035140 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-dae0120b-5ff5-439e-bfab-69f312e69324 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:19.145052 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-3ea91809-d2d5-4e27-ab6a-0ab84426b673 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:19.146028 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-3ea91809-d2d5-4e27-ab6a-0ab84426b673 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] [instance: 776433f8-bf60-4dc3-a880-ca4852e0efb6] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:19.153657 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-3ea91809-d2d5-4e27-ab6a-0ab84426b673 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:19.154436 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-3ea91809-d2d5-4e27-ab6a-0ab84426b673 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:19.155475 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-3ea91809-d2d5-4e27-ab6a-0ab84426b673 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:19.156154 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-3ea91809-d2d5-4e27-ab6a-0ab84426b673 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:19.179346 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-dae0120b-5ff5-439e-bfab-69f312e69324 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:19.189593 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-dae0120b-5ff5-439e-bfab-69f312e69324 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1722 microversion: 2.1 time: 0.168156 Jun 16 19:02:19.202370 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 199/375] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:19 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:19.254083 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [req-6f57e79f-cba8-47ff-835b-84eb04b9d088 req-93cc4a16-8a5e-4be9-b1bb-fe654f67ce50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "776433f8-bf60-4dc3-a880-ca4852e0efb6", "name": "network-vif-plugged", "status": "completed", "tag": "69181f9d-e4b3-4213-a349-724bc82a71f6"}]} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:02:19.263145 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-6f57e79f-cba8-47ff-835b-84eb04b9d088 req-93cc4a16-8a5e-4be9-b1bb-fe654f67ce50 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:19.263560 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-6f57e79f-cba8-47ff-835b-84eb04b9d088 req-93cc4a16-8a5e-4be9-b1bb-fe654f67ce50 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:19.275354 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.compute.server_external_events [req-6f57e79f-cba8-47ff-835b-84eb04b9d088 req-93cc4a16-8a5e-4be9-b1bb-fe654f67ce50 service nova] Creating event network-vif-plugged:69181f9d-e4b3-4213-a349-724bc82a71f6 for instance 776433f8-bf60-4dc3-a880-ca4852e0efb6 on hv-cinder-84617 Jun 16 19:02:19.281066 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [req-6f57e79f-cba8-47ff-835b-84eb04b9d088 req-93cc4a16-8a5e-4be9-b1bb-fe654f67ce50 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030577 Jun 16 19:02:19.281673 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 200/376] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:02:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:02:19.301538 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-3ea91809-d2d5-4e27-ab6a-0ab84426b673 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e66f41aa3194667bd5970337fd41cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae3331bfc29456c94e309c51cb82a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:19.309852 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-3ea91809-d2d5-4e27-ab6a-0ab84426b673 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] 10.222.0.70 "GET /compute/v2.1/servers/776433f8-bf60-4dc3-a880-ca4852e0efb6" status: 200 len: 1314 microversion: 2.1 time: 0.169631 Jun 16 19:02:19.310684 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 177/377] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:19 2022] GET /compute/v2.1/servers/776433f8-bf60-4dc3-a880-ca4852e0efb6 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:02:19.517893 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-ec62d74a-5298-46ee-8f6c-b359fa524f01 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:19.519108 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-ec62d74a-5298-46ee-8f6c-b359fa524f01 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] [instance: edce90bf-b3d6-49de-a45f-9b65e1759b51] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:19.528253 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ec62d74a-5298-46ee-8f6c-b359fa524f01 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:19.528846 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ec62d74a-5298-46ee-8f6c-b359fa524f01 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:19.529845 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ec62d74a-5298-46ee-8f6c-b359fa524f01 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:19.530562 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ec62d74a-5298-46ee-8f6c-b359fa524f01 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:19.745813 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-ec62d74a-5298-46ee-8f6c-b359fa524f01 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047e841cefdd4975947b2c154412953b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741ee13164894b49be1a0fc6c1385a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:19.754011 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-ec62d74a-5298-46ee-8f6c-b359fa524f01 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] 10.222.0.70 "GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51" status: 200 len: 1595 microversion: 2.1 time: 0.242634 Jun 16 19:02:19.754825 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 201/378] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:19 2022] GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51 => generated 1595 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:20.046007 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-495f3ddd-3410-458c-bcba-999639dc0d07 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:20.046635 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-495f3ddd-3410-458c-bcba-999639dc0d07 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:20.053468 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-495f3ddd-3410-458c-bcba-999639dc0d07 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:20.053933 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-495f3ddd-3410-458c-bcba-999639dc0d07 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:20.054966 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-495f3ddd-3410-458c-bcba-999639dc0d07 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:20.056024 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-495f3ddd-3410-458c-bcba-999639dc0d07 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:20.212357 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-bbee3568-81d1-45ff-99a7-b9a2b714661a tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:20.213721 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-bbee3568-81d1-45ff-99a7-b9a2b714661a tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:20.222985 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-bbee3568-81d1-45ff-99a7-b9a2b714661a tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:20.223626 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-bbee3568-81d1-45ff-99a7-b9a2b714661a tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:20.224563 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-bbee3568-81d1-45ff-99a7-b9a2b714661a tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:20.225227 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-bbee3568-81d1-45ff-99a7-b9a2b714661a tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:20.432292 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-bbee3568-81d1-45ff-99a7-b9a2b714661a tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:20.441925 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-bbee3568-81d1-45ff-99a7-b9a2b714661a tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1722 microversion: 2.1 time: 0.236074 Jun 16 19:02:20.442965 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 202/379] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:20 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1722 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:20.447913 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-bc8fe3db-c651-4252-bd48-d141531f36da tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:20.448931 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-bc8fe3db-c651-4252-bd48-d141531f36da tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] [instance: 776433f8-bf60-4dc3-a880-ca4852e0efb6] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:20.459506 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-bc8fe3db-c651-4252-bd48-d141531f36da tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:20.460247 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-bc8fe3db-c651-4252-bd48-d141531f36da tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:20.461225 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-bc8fe3db-c651-4252-bd48-d141531f36da tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:20.461922 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-bc8fe3db-c651-4252-bd48-d141531f36da tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:20.467356 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_cell1:SELECT=100 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:02:20.490046 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-495f3ddd-3410-458c-bcba-999639dc0d07 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:20.498810 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-495f3ddd-3410-458c-bcba-999639dc0d07 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:20.500315 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-495f3ddd-3410-458c-bcba-999639dc0d07 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:20.501693 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-495f3ddd-3410-458c-bcba-999639dc0d07 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1721 microversion: 2.20 time: 0.463501 Jun 16 19:02:20.502253 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 178/380] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:20 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1721 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:02:20.927533 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-bc8fe3db-c651-4252-bd48-d141531f36da tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e66f41aa3194667bd5970337fd41cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae3331bfc29456c94e309c51cb82a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:20.938789 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-bc8fe3db-c651-4252-bd48-d141531f36da tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] 10.222.0.70 "GET /compute/v2.1/servers/776433f8-bf60-4dc3-a880-ca4852e0efb6" status: 200 len: 1314 microversion: 2.1 time: 0.494143 Jun 16 19:02:20.939163 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 203/381] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:20 2022] GET /compute/v2.1/servers/776433f8-bf60-4dc3-a880-ca4852e0efb6 => generated 1314 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:21.234240 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-d66c296a-8550-4679-bf93-1ba8619d4bf1 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1934240952", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-550046181", "security_groups": [{"name": "tempest-secgroup-smoke-1355388580"}], "block_device_mapping_v2": [{"uuid": "387f10a2-dc85-4824-b031-a1aa7eefadaf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "11bba4c6-eed3-44ef-bcb5-8b60426f2332"}]}} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:02:21.350441 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.network.neutron [None req-d66c296a-8550-4679-bf93-1ba8619d4bf1 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] validate_networks() for [('11bba4c6-eed3-44ef-bcb5-8b60426f2332', None, None, None, None, None)] {{(pid=117850) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:02:21.459856 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-7ee58582-5e38-4623-9f05-cae7eebc54c5 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:21.461072 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-7ee58582-5e38-4623-9f05-cae7eebc54c5 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:21.470011 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-7ee58582-5e38-4623-9f05-cae7eebc54c5 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:21.470761 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-7ee58582-5e38-4623-9f05-cae7eebc54c5 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:21.471810 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-7ee58582-5e38-4623-9f05-cae7eebc54c5 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:21.472406 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-7ee58582-5e38-4623-9f05-cae7eebc54c5 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:21.719372 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-7ee58582-5e38-4623-9f05-cae7eebc54c5 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:21.727946 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-7ee58582-5e38-4623-9f05-cae7eebc54c5 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1722 microversion: 2.1 time: 0.271913 Jun 16 19:02:21.729233 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 204/382] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:21 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1722 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:02:21.734126 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-67d39547-7bfb-4c34-882c-563f3ad294e7 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:21.735809 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-67d39547-7bfb-4c34-882c-563f3ad294e7 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:21.742441 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-67d39547-7bfb-4c34-882c-563f3ad294e7 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:21.743187 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-67d39547-7bfb-4c34-882c-563f3ad294e7 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:21.744922 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-67d39547-7bfb-4c34-882c-563f3ad294e7 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:21.745816 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-67d39547-7bfb-4c34-882c-563f3ad294e7 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:21.777962 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-d66c296a-8550-4679-bf93-1ba8619d4bf1 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Flavor limits 0:0:0 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:02:21.778387 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-d66c296a-8550-4679-bf93-1ba8619d4bf1 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Image limits 0:0:0 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:02:21.778923 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-d66c296a-8550-4679-bf93-1ba8619d4bf1 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Flavor pref 0:0:0 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:02:21.779331 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-d66c296a-8550-4679-bf93-1ba8619d4bf1 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Image pref 0:0:0 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:02:21.779744 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-d66c296a-8550-4679-bf93-1ba8619d4bf1 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:02:21.788738 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d66c296a-8550-4679-bf93-1ba8619d4bf1 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:21.789187 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d66c296a-8550-4679-bf93-1ba8619d4bf1 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:21.790230 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d66c296a-8550-4679-bf93-1ba8619d4bf1 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:21.790700 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d66c296a-8550-4679-bf93-1ba8619d4bf1 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:21.809340 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.quota [None req-d66c296a-8550-4679-bf93-1ba8619d4bf1 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Getting quotas for project 0e52189be8d24c9894ef05cc7acf367c. Resources: {'cores', 'ram', 'instances'} {{(pid=117850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:02:21.813459 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.quota [None req-d66c296a-8550-4679-bf93-1ba8619d4bf1 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Getting quotas for user 922a970a740444a2959c6aa1d0921ee7 and project 0e52189be8d24c9894ef05cc7acf367c. Resources: {'cores', 'ram', 'instances'} {{(pid=117850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:02:21.879297 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-d66c296a-8550-4679-bf93-1ba8619d4bf1 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Going to run 1 instances... {{(pid=117850) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:02:21.881427 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-d66c296a-8550-4679-bf93-1ba8619d4bf1 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: b99da3e1-cab4-41a0-a1e4-6a29efeb77f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='387f10a2-dc85-4824-b031-a1aa7eefadaf',volume_size=None,volume_type=None)] {{(pid=117850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:02:22.001929 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-67d39547-7bfb-4c34-882c-563f3ad294e7 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:22.010331 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-67d39547-7bfb-4c34-882c-563f3ad294e7 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:22.012057 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-67d39547-7bfb-4c34-882c-563f3ad294e7 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:22.013992 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-67d39547-7bfb-4c34-882c-563f3ad294e7 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1721 microversion: 2.20 time: 0.282763 Jun 16 19:02:22.023371 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 205/383] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:21 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1721 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:02:22.026512 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-d66c296a-8550-4679-bf93-1ba8619d4bf1 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.796071 Jun 16 19:02:22.027897 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 179/384] 10.222.0.70 () {60 vars in 1146 bytes} [Thu Jun 16 19:02:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 798 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:02:22.036552 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-0fb10002-109b-4cc9-802f-fec00804f9e0 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:22.037170 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-0fb10002-109b-4cc9-802f-fec00804f9e0 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] [instance: 776433f8-bf60-4dc3-a880-ca4852e0efb6] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:22.039962 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-d47ac68a-4bb0-4739-8df8-33fa8b5b86ad tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:22.040884 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-d47ac68a-4bb0-4739-8df8-33fa8b5b86ad tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: b99da3e1-cab4-41a0-a1e4-6a29efeb77f2] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:22.045489 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-0fb10002-109b-4cc9-802f-fec00804f9e0 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:22.046015 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-0fb10002-109b-4cc9-802f-fec00804f9e0 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:22.047136 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-0fb10002-109b-4cc9-802f-fec00804f9e0 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:22.047567 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-0fb10002-109b-4cc9-802f-fec00804f9e0 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:22.106870 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-d47ac68a-4bb0-4739-8df8-33fa8b5b86ad tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:22.114479 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-d47ac68a-4bb0-4739-8df8-33fa8b5b86ad tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2" status: 200 len: 1094 microversion: 2.1 time: 0.078980 Jun 16 19:02:22.115650 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 180/385] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:22 2022] GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2 => generated 1094 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:22.310786 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-0fb10002-109b-4cc9-802f-fec00804f9e0 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e66f41aa3194667bd5970337fd41cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae3331bfc29456c94e309c51cb82a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:22.334262 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [req-4f5a3bc2-c3ee-488f-a3ec-3dced3dc7764 req-8c7d5e2c-cfc6-446e-a1f6-e41029b3dbc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edce90bf-b3d6-49de-a45f-9b65e1759b51", "tag": "1ff09938-bf10-4206-8fd9-6a39acb93f8c"}]} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:02:22.347976 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-0fb10002-109b-4cc9-802f-fec00804f9e0 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] 10.222.0.70 "GET /compute/v2.1/servers/776433f8-bf60-4dc3-a880-ca4852e0efb6" status: 200 len: 1314 microversion: 2.1 time: 0.323205 Jun 16 19:02:22.348746 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 206/386] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:22 2022] GET /compute/v2.1/servers/776433f8-bf60-4dc3-a880-ca4852e0efb6 => generated 1314 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:22.350753 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:02:22.358447 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-4f5a3bc2-c3ee-488f-a3ec-3dced3dc7764 req-8c7d5e2c-cfc6-446e-a1f6-e41029b3dbc4 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:22.359211 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-4f5a3bc2-c3ee-488f-a3ec-3dced3dc7764 req-8c7d5e2c-cfc6-446e-a1f6-e41029b3dbc4 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:22.374517 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.compute.server_external_events [req-4f5a3bc2-c3ee-488f-a3ec-3dced3dc7764 req-8c7d5e2c-cfc6-446e-a1f6-e41029b3dbc4 service nova] Creating event network-changed:1ff09938-bf10-4206-8fd9-6a39acb93f8c for instance edce90bf-b3d6-49de-a45f-9b65e1759b51 on hv-cinder-84617 Jun 16 19:02:22.380018 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [req-4f5a3bc2-c3ee-488f-a3ec-3dced3dc7764 req-8c7d5e2c-cfc6-446e-a1f6-e41029b3dbc4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059570 Jun 16 19:02:22.383568 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 181/387] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:02:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:02:22.746216 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-d1662130-062e-42e4-a105-a6ce004188d1 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:22.747022 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-d1662130-062e-42e4-a105-a6ce004188d1 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:22.754849 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d1662130-062e-42e4-a105-a6ce004188d1 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:22.755621 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d1662130-062e-42e4-a105-a6ce004188d1 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:22.756840 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d1662130-062e-42e4-a105-a6ce004188d1 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:22.757552 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d1662130-062e-42e4-a105-a6ce004188d1 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:22.932686 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-d1662130-062e-42e4-a105-a6ce004188d1 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:22.942092 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-d1662130-062e-42e4-a105-a6ce004188d1 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1722 microversion: 2.1 time: 0.199932 Jun 16 19:02:22.942700 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 207/388] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:22 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1722 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:23.033474 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-6e54a14c-0092-4720-b8b4-82344f299012 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:23.034178 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-6e54a14c-0092-4720-b8b4-82344f299012 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:23.042059 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-6e54a14c-0092-4720-b8b4-82344f299012 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:23.042508 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-6e54a14c-0092-4720-b8b4-82344f299012 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:23.043517 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-6e54a14c-0092-4720-b8b4-82344f299012 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:23.043963 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-6e54a14c-0092-4720-b8b4-82344f299012 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:23.132693 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-ee498abf-fbec-4e1c-9500-d829f5459f40 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:23.133934 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-ee498abf-fbec-4e1c-9500-d829f5459f40 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: b99da3e1-cab4-41a0-a1e4-6a29efeb77f2] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:23.140971 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ee498abf-fbec-4e1c-9500-d829f5459f40 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:23.141420 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ee498abf-fbec-4e1c-9500-d829f5459f40 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:23.142190 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ee498abf-fbec-4e1c-9500-d829f5459f40 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:23.142862 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ee498abf-fbec-4e1c-9500-d829f5459f40 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:23.256423 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-ee498abf-fbec-4e1c-9500-d829f5459f40 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:23.266532 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-ee498abf-fbec-4e1c-9500-d829f5459f40 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2" status: 200 len: 1144 microversion: 2.1 time: 0.137954 Jun 16 19:02:23.269808 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 208/389] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:23 2022] GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2 => generated 1144 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:23.358977 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-6e54a14c-0092-4720-b8b4-82344f299012 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:23.363893 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [req-3afad303-fd15-4895-aa69-c4b907afd564 req-b0ed69a8-d32f-4142-8324-e82cf80ebe9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c077a29-12e0-48af-a8b6-43d0b5a79bf4", "name": "network-vif-unplugged", "status": "completed", "tag": "3e9e841e-467e-4321-a3d7-1999929bc359"}]} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:02:23.369095 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-6e54a14c-0092-4720-b8b4-82344f299012 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:23.370763 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-6e54a14c-0092-4720-b8b4-82344f299012 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:23.372154 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-6e54a14c-0092-4720-b8b4-82344f299012 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1721 microversion: 2.20 time: 0.342927 Jun 16 19:02:23.373315 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 182/390] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:23 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1721 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:02:23.378532 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-b770e52f-fa09-454b-8610-05cd4b8f7b5b tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:23.379223 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-3afad303-fd15-4895-aa69-c4b907afd564 req-b0ed69a8-d32f-4142-8324-e82cf80ebe9b service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:23.379423 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-b770e52f-fa09-454b-8610-05cd4b8f7b5b tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] [instance: 776433f8-bf60-4dc3-a880-ca4852e0efb6] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:23.379665 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-3afad303-fd15-4895-aa69-c4b907afd564 req-b0ed69a8-d32f-4142-8324-e82cf80ebe9b service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:23.393366 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b770e52f-fa09-454b-8610-05cd4b8f7b5b tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:23.393554 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.compute.server_external_events [req-3afad303-fd15-4895-aa69-c4b907afd564 req-b0ed69a8-d32f-4142-8324-e82cf80ebe9b service nova] Creating event network-vif-unplugged:3e9e841e-467e-4321-a3d7-1999929bc359 for instance 1c077a29-12e0-48af-a8b6-43d0b5a79bf4 on hv-cinder-84617 Jun 16 19:02:23.395534 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b770e52f-fa09-454b-8610-05cd4b8f7b5b tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:23.397569 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b770e52f-fa09-454b-8610-05cd4b8f7b5b tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:23.398306 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b770e52f-fa09-454b-8610-05cd4b8f7b5b tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:23.404135 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [req-3afad303-fd15-4895-aa69-c4b907afd564 req-b0ed69a8-d32f-4142-8324-e82cf80ebe9b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050797 Jun 16 19:02:23.405555 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 209/391] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:02:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:02:23.602113 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-b770e52f-fa09-454b-8610-05cd4b8f7b5b tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e66f41aa3194667bd5970337fd41cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae3331bfc29456c94e309c51cb82a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:23.605518 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:02:23.626494 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-b770e52f-fa09-454b-8610-05cd4b8f7b5b tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] 10.222.0.70 "GET /compute/v2.1/servers/776433f8-bf60-4dc3-a880-ca4852e0efb6" status: 200 len: 1314 microversion: 2.1 time: 0.248900 Jun 16 19:02:23.628525 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 183/392] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:23 2022] GET /compute/v2.1/servers/776433f8-bf60-4dc3-a880-ca4852e0efb6 => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:23.693976 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-47910673-6dc0-4c15-ab6f-d9e419d7d456 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2128678587"}} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:02:23.694666 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-47910673-6dc0-4c15-ab6f-d9e419d7d456 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] [instance: edce90bf-b3d6-49de-a45f-9b65e1759b51] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:23.706295 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-47910673-6dc0-4c15-ab6f-d9e419d7d456 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:23.706770 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-47910673-6dc0-4c15-ab6f-d9e419d7d456 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:23.707554 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-47910673-6dc0-4c15-ab6f-d9e419d7d456 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:23.707987 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-47910673-6dc0-4c15-ab6f-d9e419d7d456 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:23.851993 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.network.security_group_api [None req-47910673-6dc0-4c15-ab6f-d9e419d7d456 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Adding security group 5ff40db3-128a-4a4b-aa09-d864e5fc8232 to port 1ff09938-bf10-4206-8fd9-6a39acb93f8c Jun 16 19:02:23.960211 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-d67e91ad-7165-4f5f-8ce0-becbc0802af8 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:23.961165 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-d67e91ad-7165-4f5f-8ce0-becbc0802af8 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:23.968686 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d67e91ad-7165-4f5f-8ce0-becbc0802af8 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:23.969137 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d67e91ad-7165-4f5f-8ce0-becbc0802af8 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:23.969905 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d67e91ad-7165-4f5f-8ce0-becbc0802af8 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:23.970342 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d67e91ad-7165-4f5f-8ce0-becbc0802af8 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:24.102007 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-d67e91ad-7165-4f5f-8ce0-becbc0802af8 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:24.110219 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-d67e91ad-7165-4f5f-8ce0-becbc0802af8 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1722 microversion: 2.1 time: 0.154258 Jun 16 19:02:24.110830 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 184/393] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:23 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:02:24.226375 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-47910673-6dc0-4c15-ab6f-d9e419d7d456 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] 10.222.0.70 "POST /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51/action" status: 202 len: 0 microversion: 2.1 time: 0.537274 Jun 16 19:02:24.227050 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 210/394] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Jun 16 19:02:23 2022] POST /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51/action => generated 0 bytes in 539 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:02:24.236113 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-0d3d7b46-51a2-4e93-b6b1-6425d6d1aed0 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:24.237102 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-0d3d7b46-51a2-4e93-b6b1-6425d6d1aed0 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] [instance: edce90bf-b3d6-49de-a45f-9b65e1759b51] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:24.245485 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0d3d7b46-51a2-4e93-b6b1-6425d6d1aed0 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:24.246231 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0d3d7b46-51a2-4e93-b6b1-6425d6d1aed0 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:24.247638 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0d3d7b46-51a2-4e93-b6b1-6425d6d1aed0 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:24.248161 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0d3d7b46-51a2-4e93-b6b1-6425d6d1aed0 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:24.286954 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-79a957e7-b604-4dfd-99fc-2e2b1a599a6d tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:24.287934 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-79a957e7-b604-4dfd-99fc-2e2b1a599a6d tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: b99da3e1-cab4-41a0-a1e4-6a29efeb77f2] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:24.295960 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-79a957e7-b604-4dfd-99fc-2e2b1a599a6d tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:24.296657 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-79a957e7-b604-4dfd-99fc-2e2b1a599a6d tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:24.297638 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-79a957e7-b604-4dfd-99fc-2e2b1a599a6d tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:24.298073 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-79a957e7-b604-4dfd-99fc-2e2b1a599a6d tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:24.389934 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-79a957e7-b604-4dfd-99fc-2e2b1a599a6d tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:24.399189 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-79a957e7-b604-4dfd-99fc-2e2b1a599a6d tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2" status: 200 len: 1144 microversion: 2.1 time: 0.116113 Jun 16 19:02:24.401166 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 211/395] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:24 2022] GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2 => generated 1144 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:02:24.408000 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-b83dcf8f-65d0-4fc1-ab84-8bf5097c99ce tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:24.408839 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-b83dcf8f-65d0-4fc1-ab84-8bf5097c99ce tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:24.417641 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-b83dcf8f-65d0-4fc1-ab84-8bf5097c99ce tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:24.418346 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-b83dcf8f-65d0-4fc1-ab84-8bf5097c99ce tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:24.419365 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-b83dcf8f-65d0-4fc1-ab84-8bf5097c99ce tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:24.419948 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-b83dcf8f-65d0-4fc1-ab84-8bf5097c99ce tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:24.627600 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-0d3d7b46-51a2-4e93-b6b1-6425d6d1aed0 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047e841cefdd4975947b2c154412953b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741ee13164894b49be1a0fc6c1385a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:24.642737 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-0d3d7b46-51a2-4e93-b6b1-6425d6d1aed0 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] 10.222.0.70 "GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51" status: 200 len: 1642 microversion: 2.1 time: 0.410885 Jun 16 19:02:24.645280 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 185/396] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:24 2022] GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51 => generated 1642 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:02:24.650030 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [req-7c64afbb-f679-4d6a-9e94-dbe3f8142cf8 req-68c03457-22b9-4e74-8529-36feebe25ca6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edce90bf-b3d6-49de-a45f-9b65e1759b51", "tag": "1ff09938-bf10-4206-8fd9-6a39acb93f8c"}]} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:02:24.660120 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-7c64afbb-f679-4d6a-9e94-dbe3f8142cf8 req-68c03457-22b9-4e74-8529-36feebe25ca6 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:24.660818 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-7c64afbb-f679-4d6a-9e94-dbe3f8142cf8 req-68c03457-22b9-4e74-8529-36feebe25ca6 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:24.674138 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.compute.server_external_events [req-7c64afbb-f679-4d6a-9e94-dbe3f8142cf8 req-68c03457-22b9-4e74-8529-36feebe25ca6 service nova] Creating event network-changed:1ff09938-bf10-4206-8fd9-6a39acb93f8c for instance edce90bf-b3d6-49de-a45f-9b65e1759b51 on hv-cinder-84617 Jun 16 19:02:24.682742 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [req-7c64afbb-f679-4d6a-9e94-dbe3f8142cf8 req-68c03457-22b9-4e74-8529-36feebe25ca6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033971 Jun 16 19:02:24.684835 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 186/397] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:02:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:02:24.685983 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-b83dcf8f-65d0-4fc1-ab84-8bf5097c99ce tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:24.692987 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-33f0b725-cc93-41ee-be55-e5ac05156f14 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:24.694258 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-33f0b725-cc93-41ee-be55-e5ac05156f14 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] [instance: 776433f8-bf60-4dc3-a880-ca4852e0efb6] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:24.700296 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-b83dcf8f-65d0-4fc1-ab84-8bf5097c99ce tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:24.701825 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-b83dcf8f-65d0-4fc1-ab84-8bf5097c99ce tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:24.703060 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-b83dcf8f-65d0-4fc1-ab84-8bf5097c99ce tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1721 microversion: 2.20 time: 0.300611 Jun 16 19:02:24.703829 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-33f0b725-cc93-41ee-be55-e5ac05156f14 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:24.704731 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-33f0b725-cc93-41ee-be55-e5ac05156f14 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:24.705115 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 212/398] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:24 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1721 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:02:24.706090 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-33f0b725-cc93-41ee-be55-e5ac05156f14 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:24.706690 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-33f0b725-cc93-41ee-be55-e5ac05156f14 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:24.988260 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-33f0b725-cc93-41ee-be55-e5ac05156f14 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e66f41aa3194667bd5970337fd41cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae3331bfc29456c94e309c51cb82a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:24.997362 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-33f0b725-cc93-41ee-be55-e5ac05156f14 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] 10.222.0.70 "GET /compute/v2.1/servers/776433f8-bf60-4dc3-a880-ca4852e0efb6" status: 200 len: 1464 microversion: 2.1 time: 0.310377 Jun 16 19:02:25.007084 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 187/399] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:24 2022] GET /compute/v2.1/servers/776433f8-bf60-4dc3-a880-ca4852e0efb6 => generated 1464 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:25.044936 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-e992ecc2-2957-41fc-8363-296cffdb1006 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:25.047441 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-e992ecc2-2957-41fc-8363-296cffdb1006 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] [instance: 776433f8-bf60-4dc3-a880-ca4852e0efb6] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:25.058475 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-e992ecc2-2957-41fc-8363-296cffdb1006 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:25.059330 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-e992ecc2-2957-41fc-8363-296cffdb1006 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:25.060326 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-e992ecc2-2957-41fc-8363-296cffdb1006 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:25.060860 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-e992ecc2-2957-41fc-8363-296cffdb1006 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:25.091874 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-e992ecc2-2957-41fc-8363-296cffdb1006 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] [instance: 776433f8-bf60-4dc3-a880-ca4852e0efb6] Going to try to terminate instance {{(pid=117852) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:02:25.130995 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-0a99395f-14e7-4b0f-9119-57557a1770cf tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:25.131511 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-0a99395f-14e7-4b0f-9119-57557a1770cf tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:25.143381 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0a99395f-14e7-4b0f-9119-57557a1770cf tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:25.144064 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0a99395f-14e7-4b0f-9119-57557a1770cf tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:25.144902 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0a99395f-14e7-4b0f-9119-57557a1770cf tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:25.145344 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0a99395f-14e7-4b0f-9119-57557a1770cf tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:25.202508 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-e992ecc2-2957-41fc-8363-296cffdb1006 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] 10.222.0.70 "DELETE /compute/v2.1/servers/776433f8-bf60-4dc3-a880-ca4852e0efb6" status: 204 len: 0 microversion: 2.1 time: 0.161251 Jun 16 19:02:25.204063 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 213/400] 10.222.0.70 () {58 vars in 1238 bytes} [Thu Jun 16 19:02:25 2022] DELETE /compute/v2.1/servers/776433f8-bf60-4dc3-a880-ca4852e0efb6 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:02:25.217798 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-c1df7e59-e22c-4d43-a195-d10652c6dde9 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:25.219344 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-c1df7e59-e22c-4d43-a195-d10652c6dde9 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] [instance: 776433f8-bf60-4dc3-a880-ca4852e0efb6] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:25.231293 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-c1df7e59-e22c-4d43-a195-d10652c6dde9 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:25.232154 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-c1df7e59-e22c-4d43-a195-d10652c6dde9 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:25.233869 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-c1df7e59-e22c-4d43-a195-d10652c6dde9 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:25.234771 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-c1df7e59-e22c-4d43-a195-d10652c6dde9 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:25.398712 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-c1df7e59-e22c-4d43-a195-d10652c6dde9 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e66f41aa3194667bd5970337fd41cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae3331bfc29456c94e309c51cb82a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:25.407803 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-c1df7e59-e22c-4d43-a195-d10652c6dde9 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] 10.222.0.70 "GET /compute/v2.1/servers/776433f8-bf60-4dc3-a880-ca4852e0efb6" status: 200 len: 1470 microversion: 2.1 time: 0.199062 Jun 16 19:02:25.408391 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 214/401] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:25 2022] GET /compute/v2.1/servers/776433f8-bf60-4dc3-a880-ca4852e0efb6 => generated 1470 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:25.417437 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-e97d43e1-c699-4a73-9f19-aeffb5bab594 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:25.418174 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-e97d43e1-c699-4a73-9f19-aeffb5bab594 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: b99da3e1-cab4-41a0-a1e4-6a29efeb77f2] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:25.424278 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-e97d43e1-c699-4a73-9f19-aeffb5bab594 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:25.424805 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-e97d43e1-c699-4a73-9f19-aeffb5bab594 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:25.425707 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-e97d43e1-c699-4a73-9f19-aeffb5bab594 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:25.426239 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-e97d43e1-c699-4a73-9f19-aeffb5bab594 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:25.468964 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-0a99395f-14e7-4b0f-9119-57557a1770cf tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:25.478280 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-0a99395f-14e7-4b0f-9119-57557a1770cf tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1699 microversion: 2.1 time: 0.353996 Jun 16 19:02:25.478939 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 188/402] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:25 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1699 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:25.492388 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-e97d43e1-c699-4a73-9f19-aeffb5bab594 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:25.498033 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-c76cf766-641f-482d-ba1f-1e367364ec93 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:02:25.501132 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-e97d43e1-c699-4a73-9f19-aeffb5bab594 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2" status: 200 len: 1192 microversion: 2.1 time: 0.088067 Jun 16 19:02:25.501716 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 215/403] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:25 2022] GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2 => generated 1192 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:25.504939 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-c76cf766-641f-482d-ba1f-1e367364ec93 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:25.505417 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-c76cf766-641f-482d-ba1f-1e367364ec93 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:25.584419 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-c76cf766-641f-482d-ba1f-1e367364ec93 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Going to try to start instance {{(pid=117850) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 16 19:02:25.633736 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-c76cf766-641f-482d-ba1f-1e367364ec93 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "POST /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee/action" status: 202 len: 0 microversion: 2.1 time: 0.140190 Jun 16 19:02:25.639777 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 189/404] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Jun 16 19:02:25 2022] POST /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 19:02:25.645076 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-ab30c2f9-3723-406c-8e60-eb15fa7aa6fc tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:25.645704 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-ab30c2f9-3723-406c-8e60-eb15fa7aa6fc tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:25.653066 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ab30c2f9-3723-406c-8e60-eb15fa7aa6fc tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:25.656729 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ab30c2f9-3723-406c-8e60-eb15fa7aa6fc tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:25.657619 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ab30c2f9-3723-406c-8e60-eb15fa7aa6fc tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:25.658382 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ab30c2f9-3723-406c-8e60-eb15fa7aa6fc tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:25.722883 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-859cc4ff-50b9-4294-afd4-e3af517d7018 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:25.723928 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-859cc4ff-50b9-4294-afd4-e3af517d7018 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:25.731510 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-859cc4ff-50b9-4294-afd4-e3af517d7018 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:25.732098 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-859cc4ff-50b9-4294-afd4-e3af517d7018 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:25.733078 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-859cc4ff-50b9-4294-afd4-e3af517d7018 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:25.733502 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-859cc4ff-50b9-4294-afd4-e3af517d7018 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:25.798135 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-ab30c2f9-3723-406c-8e60-eb15fa7aa6fc tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:25.806221 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-ab30c2f9-3723-406c-8e60-eb15fa7aa6fc tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1708 microversion: 2.1 time: 0.165133 Jun 16 19:02:25.807486 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 216/405] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:25 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1708 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:25.909327 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-859cc4ff-50b9-4294-afd4-e3af517d7018 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:25.917703 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-859cc4ff-50b9-4294-afd4-e3af517d7018 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:25.919347 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-859cc4ff-50b9-4294-afd4-e3af517d7018 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:25.920589 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-859cc4ff-50b9-4294-afd4-e3af517d7018 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1664 microversion: 2.20 time: 0.202115 Jun 16 19:02:25.921143 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 190/406] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:25 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1664 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:02:25.939027 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-4b0c067e-2607-4f1d-be1b-b60b4acb624c tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d2b007ef-9605-43d7-88d1-91d3fd787015"}} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:02:25.940342 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-4b0c067e-2607-4f1d-be1b-b60b4acb624c tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:25.946453 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-4b0c067e-2607-4f1d-be1b-b60b4acb624c tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:25.947763 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-4b0c067e-2607-4f1d-be1b-b60b4acb624c tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:25.948830 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-4b0c067e-2607-4f1d-be1b-b60b4acb624c tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:25.949449 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-4b0c067e-2607-4f1d-be1b-b60b4acb624c tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:26.141471 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:02:26.265324 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-4b0c067e-2607-4f1d-be1b-b60b4acb624c tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "POST /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.330226 Jun 16 19:02:26.270638 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 217/407] 10.222.0.70 () {62 vars in 1363 bytes} [Thu Jun 16 19:02:25 2022] POST /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4/os-volume_attachments => generated 188 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 19:02:26.383719 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-6a8656c6-e99e-48ee-8d1f-2aea045b70a7 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:02:26.384285 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-6a8656c6-e99e-48ee-8d1f-2aea045b70a7 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:26.391581 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-6a8656c6-e99e-48ee-8d1f-2aea045b70a7 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:26.392027 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-6a8656c6-e99e-48ee-8d1f-2aea045b70a7 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:26.392918 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-6a8656c6-e99e-48ee-8d1f-2aea045b70a7 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:26.393188 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-6a8656c6-e99e-48ee-8d1f-2aea045b70a7 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:26.425222 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-08f56992-d80f-4f8b-8502-d8f4d6714ca5 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:26.425784 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-08f56992-d80f-4f8b-8502-d8f4d6714ca5 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] [instance: 776433f8-bf60-4dc3-a880-ca4852e0efb6] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:26.432209 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-08f56992-d80f-4f8b-8502-d8f4d6714ca5 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:26.432990 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-08f56992-d80f-4f8b-8502-d8f4d6714ca5 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:26.433830 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-08f56992-d80f-4f8b-8502-d8f4d6714ca5 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:26.434339 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-08f56992-d80f-4f8b-8502-d8f4d6714ca5 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:26.510522 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-6a8656c6-e99e-48ee-8d1f-2aea045b70a7 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "POST /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4/action" status: 202 len: 0 microversion: 2.20 time: 0.129961 Jun 16 19:02:26.511737 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 191/408] 10.222.0.70 () {62 vars in 1318 bytes} [Thu Jun 16 19:02:26 2022] POST /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:02:26.521333 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-d06d1d9d-4a45-458d-b9e9-ac8f33ecf6aa tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:26.521957 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-d06d1d9d-4a45-458d-b9e9-ac8f33ecf6aa tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: b99da3e1-cab4-41a0-a1e4-6a29efeb77f2] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:26.531459 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d06d1d9d-4a45-458d-b9e9-ac8f33ecf6aa tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:26.531915 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d06d1d9d-4a45-458d-b9e9-ac8f33ecf6aa tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:26.532937 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d06d1d9d-4a45-458d-b9e9-ac8f33ecf6aa tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:26.533505 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d06d1d9d-4a45-458d-b9e9-ac8f33ecf6aa tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:26.619026 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-d06d1d9d-4a45-458d-b9e9-ac8f33ecf6aa tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:26.627198 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-d06d1d9d-4a45-458d-b9e9-ac8f33ecf6aa tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2" status: 200 len: 1192 microversion: 2.1 time: 0.112292 Jun 16 19:02:26.628503 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 192/409] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:26 2022] GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2 => generated 1192 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:02:26.632348 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-08f56992-d80f-4f8b-8502-d8f4d6714ca5 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e66f41aa3194667bd5970337fd41cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae3331bfc29456c94e309c51cb82a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:26.634082 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-27ee3611-aae6-455b-9095-574a069c41ee tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:26.635316 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-27ee3611-aae6-455b-9095-574a069c41ee tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:26.641538 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-08f56992-d80f-4f8b-8502-d8f4d6714ca5 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] 10.222.0.70 "GET /compute/v2.1/servers/776433f8-bf60-4dc3-a880-ca4852e0efb6" status: 200 len: 1470 microversion: 2.1 time: 0.220138 Jun 16 19:02:26.642008 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-27ee3611-aae6-455b-9095-574a069c41ee tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:26.642128 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 218/410] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:26 2022] GET /compute/v2.1/servers/776433f8-bf60-4dc3-a880-ca4852e0efb6 => generated 1470 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:26.642969 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-27ee3611-aae6-455b-9095-574a069c41ee tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:26.643752 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-27ee3611-aae6-455b-9095-574a069c41ee tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:26.644188 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-27ee3611-aae6-455b-9095-574a069c41ee tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:26.816088 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-27ee3611-aae6-455b-9095-574a069c41ee tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:26.825073 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-27ee3611-aae6-455b-9095-574a069c41ee tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:26.825270 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-20074ab0-a514-4076-8056-0efbcaba52c1 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:26.825845 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-20074ab0-a514-4076-8056-0efbcaba52c1 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:26.826683 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-27ee3611-aae6-455b-9095-574a069c41ee tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:26.827973 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-27ee3611-aae6-455b-9095-574a069c41ee tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1750 microversion: 2.20 time: 0.197686 Jun 16 19:02:26.828945 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 193/411] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:26 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1750 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:02:26.831939 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-20074ab0-a514-4076-8056-0efbcaba52c1 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:26.832382 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-20074ab0-a514-4076-8056-0efbcaba52c1 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:26.833301 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-20074ab0-a514-4076-8056-0efbcaba52c1 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:26.833925 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-20074ab0-a514-4076-8056-0efbcaba52c1 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:26.974797 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-20074ab0-a514-4076-8056-0efbcaba52c1 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:26.984536 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-20074ab0-a514-4076-8056-0efbcaba52c1 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1708 microversion: 2.1 time: 0.163279 Jun 16 19:02:26.985323 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 219/412] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:26 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1708 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:02:27.644796 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-fcac561c-0dd8-4d76-ae4a-ea97b0aac45c tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:27.645467 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-fcac561c-0dd8-4d76-ae4a-ea97b0aac45c tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: b99da3e1-cab4-41a0-a1e4-6a29efeb77f2] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:27.658223 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-fcac561c-0dd8-4d76-ae4a-ea97b0aac45c tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:27.659746 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-fcac561c-0dd8-4d76-ae4a-ea97b0aac45c tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:27.660552 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-fcac561c-0dd8-4d76-ae4a-ea97b0aac45c tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:27.660998 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-fcac561c-0dd8-4d76-ae4a-ea97b0aac45c tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:27.662168 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-9821fca1-cfae-4824-95f2-c9d7007df226 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:27.664411 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-9821fca1-cfae-4824-95f2-c9d7007df226 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] [instance: 776433f8-bf60-4dc3-a880-ca4852e0efb6] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:27.673956 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-9821fca1-cfae-4824-95f2-c9d7007df226 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:27.674826 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-9821fca1-cfae-4824-95f2-c9d7007df226 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:27.675901 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-9821fca1-cfae-4824-95f2-c9d7007df226 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:27.685080 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-9821fca1-cfae-4824-95f2-c9d7007df226 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:28.019973 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-fcac561c-0dd8-4d76-ae4a-ea97b0aac45c tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:28.031996 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-fcac561c-0dd8-4d76-ae4a-ea97b0aac45c tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2" status: 200 len: 1210 microversion: 2.1 time: 0.391249 Jun 16 19:02:28.034162 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 194/413] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:27 2022] GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2 => generated 1210 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:28.039031 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-4b404e48-3e41-4f96-8de9-714c4f4aa764 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:28.039674 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-4b404e48-3e41-4f96-8de9-714c4f4aa764 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:28.060566 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-4b404e48-3e41-4f96-8de9-714c4f4aa764 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:28.061699 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-4b404e48-3e41-4f96-8de9-714c4f4aa764 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:28.062509 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-4b404e48-3e41-4f96-8de9-714c4f4aa764 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:28.062975 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-4b404e48-3e41-4f96-8de9-714c4f4aa764 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:28.243479 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-9821fca1-cfae-4824-95f2-c9d7007df226 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e66f41aa3194667bd5970337fd41cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae3331bfc29456c94e309c51cb82a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:28.254991 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-9821fca1-cfae-4824-95f2-c9d7007df226 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] 10.222.0.70 "GET /compute/v2.1/servers/776433f8-bf60-4dc3-a880-ca4852e0efb6" status: 200 len: 1470 microversion: 2.1 time: 0.598248 Jun 16 19:02:28.265540 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 220/414] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:27 2022] GET /compute/v2.1/servers/776433f8-bf60-4dc3-a880-ca4852e0efb6 => generated 1470 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:28.265540 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-40f4fb91-3329-4efa-a7ac-031238eddedf tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:28.265540 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-40f4fb91-3329-4efa-a7ac-031238eddedf tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:28.281055 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-40f4fb91-3329-4efa-a7ac-031238eddedf tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:28.281511 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-40f4fb91-3329-4efa-a7ac-031238eddedf tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:28.282297 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-40f4fb91-3329-4efa-a7ac-031238eddedf tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:28.282799 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-40f4fb91-3329-4efa-a7ac-031238eddedf tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:28.554751 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-4b404e48-3e41-4f96-8de9-714c4f4aa764 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:28.567958 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-4b404e48-3e41-4f96-8de9-714c4f4aa764 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:28.573692 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-4b404e48-3e41-4f96-8de9-714c4f4aa764 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:28.576969 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-4b404e48-3e41-4f96-8de9-714c4f4aa764 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1752 microversion: 2.20 time: 0.541632 Jun 16 19:02:28.581183 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 195/415] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:28 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1752 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:02:28.849140 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-40f4fb91-3329-4efa-a7ac-031238eddedf tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:28.865001 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-40f4fb91-3329-4efa-a7ac-031238eddedf tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1708 microversion: 2.1 time: 0.608361 Jun 16 19:02:28.869289 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 221/416] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:28 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1708 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:29.052266 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-5ae10f11-c4db-4c79-b26f-5b161c625ca3 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:29.054787 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-5ae10f11-c4db-4c79-b26f-5b161c625ca3 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: b99da3e1-cab4-41a0-a1e4-6a29efeb77f2] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:29.064131 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-5ae10f11-c4db-4c79-b26f-5b161c625ca3 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:29.064726 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-5ae10f11-c4db-4c79-b26f-5b161c625ca3 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:29.065767 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-5ae10f11-c4db-4c79-b26f-5b161c625ca3 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:29.066349 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-5ae10f11-c4db-4c79-b26f-5b161c625ca3 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:29.192904 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-5ae10f11-c4db-4c79-b26f-5b161c625ca3 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:29.206505 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-5ae10f11-c4db-4c79-b26f-5b161c625ca3 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2" status: 200 len: 1198 microversion: 2.1 time: 0.158165 Jun 16 19:02:29.223139 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [req-fad3a688-6cf9-4be0-94d2-fbf8a3b2342a req-a6f14e8d-1e6f-4f9b-a8a9-83a3aa600462 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "776433f8-bf60-4dc3-a880-ca4852e0efb6", "name": "network-vif-deleted", "tag": "69181f9d-e4b3-4213-a349-724bc82a71f6"}]} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:02:29.228007 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 196/417] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:29 2022] GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2 => generated 1198 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:29.233835 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-fad3a688-6cf9-4be0-94d2-fbf8a3b2342a req-a6f14e8d-1e6f-4f9b-a8a9-83a3aa600462 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:29.234678 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-fad3a688-6cf9-4be0-94d2-fbf8a3b2342a req-a6f14e8d-1e6f-4f9b-a8a9-83a3aa600462 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:29.250028 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.compute.server_external_events [req-fad3a688-6cf9-4be0-94d2-fbf8a3b2342a req-a6f14e8d-1e6f-4f9b-a8a9-83a3aa600462 service nova] Creating event network-vif-deleted:69181f9d-e4b3-4213-a349-724bc82a71f6 for instance 776433f8-bf60-4dc3-a880-ca4852e0efb6 on hv-cinder-84617 Jun 16 19:02:29.257980 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [req-fad3a688-6cf9-4be0-94d2-fbf8a3b2342a req-a6f14e8d-1e6f-4f9b-a8a9-83a3aa600462 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038982 Jun 16 19:02:29.259268 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 222/418] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:02:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:02:29.273409 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-104f3402-80ec-4a4c-8530-b2922cf4137d tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:29.274612 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-104f3402-80ec-4a4c-8530-b2922cf4137d tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] [instance: 776433f8-bf60-4dc3-a880-ca4852e0efb6] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:29.282330 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-104f3402-80ec-4a4c-8530-b2922cf4137d tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:29.283354 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-104f3402-80ec-4a4c-8530-b2922cf4137d tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:29.284489 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-104f3402-80ec-4a4c-8530-b2922cf4137d tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:29.285244 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-104f3402-80ec-4a4c-8530-b2922cf4137d tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:29.385184 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-104f3402-80ec-4a4c-8530-b2922cf4137d tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e66f41aa3194667bd5970337fd41cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae3331bfc29456c94e309c51cb82a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:29.394197 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-104f3402-80ec-4a4c-8530-b2922cf4137d tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] 10.222.0.70 "GET /compute/v2.1/servers/776433f8-bf60-4dc3-a880-ca4852e0efb6" status: 200 len: 1428 microversion: 2.1 time: 0.124522 Jun 16 19:02:29.405048 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 197/419] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:29 2022] GET /compute/v2.1/servers/776433f8-bf60-4dc3-a880-ca4852e0efb6 => generated 1428 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:29.599863 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-9570978d-bf32-49ea-960f-98d8b7531fcb tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:29.600871 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-9570978d-bf32-49ea-960f-98d8b7531fcb tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:29.610651 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-9570978d-bf32-49ea-960f-98d8b7531fcb tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:29.611249 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-9570978d-bf32-49ea-960f-98d8b7531fcb tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:29.612670 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-9570978d-bf32-49ea-960f-98d8b7531fcb tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:29.613518 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-9570978d-bf32-49ea-960f-98d8b7531fcb tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:29.869899 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-9570978d-bf32-49ea-960f-98d8b7531fcb tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:29.878617 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-9570978d-bf32-49ea-960f-98d8b7531fcb tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:29.880216 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-9570978d-bf32-49ea-960f-98d8b7531fcb tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:29.881521 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-9570978d-bf32-49ea-960f-98d8b7531fcb tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1752 microversion: 2.20 time: 0.286435 Jun 16 19:02:29.882186 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 223/420] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:29 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1752 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:02:29.884124 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-18eb207b-0c4b-4daa-b267-ffbde3ee95c4 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:29.885644 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-18eb207b-0c4b-4daa-b267-ffbde3ee95c4 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:29.891805 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-18eb207b-0c4b-4daa-b267-ffbde3ee95c4 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:29.892256 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-18eb207b-0c4b-4daa-b267-ffbde3ee95c4 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:29.893029 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-18eb207b-0c4b-4daa-b267-ffbde3ee95c4 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:29.893467 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-18eb207b-0c4b-4daa-b267-ffbde3ee95c4 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:30.045120 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-18eb207b-0c4b-4daa-b267-ffbde3ee95c4 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:30.054095 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-18eb207b-0c4b-4daa-b267-ffbde3ee95c4 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1708 microversion: 2.1 time: 0.173698 Jun 16 19:02:30.054696 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 198/421] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:29 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1708 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:02:30.223894 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-92ff0c0f-b785-454b-b9ab-451d5e8be19b tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:30.224856 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-92ff0c0f-b785-454b-b9ab-451d5e8be19b tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: b99da3e1-cab4-41a0-a1e4-6a29efeb77f2] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:30.235023 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-92ff0c0f-b785-454b-b9ab-451d5e8be19b tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:30.237986 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-92ff0c0f-b785-454b-b9ab-451d5e8be19b tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:30.240244 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-92ff0c0f-b785-454b-b9ab-451d5e8be19b tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:30.244464 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-92ff0c0f-b785-454b-b9ab-451d5e8be19b tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:30.411441 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-e52c28ef-4523-4351-a220-f758cad87e29 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:30.412063 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-e52c28ef-4523-4351-a220-f758cad87e29 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] [instance: 776433f8-bf60-4dc3-a880-ca4852e0efb6] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:30.422637 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-e52c28ef-4523-4351-a220-f758cad87e29 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:30.423070 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-e52c28ef-4523-4351-a220-f758cad87e29 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:30.423857 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-e52c28ef-4523-4351-a220-f758cad87e29 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:30.424345 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-e52c28ef-4523-4351-a220-f758cad87e29 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:30.471773 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:02:30.498891 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-e52c28ef-4523-4351-a220-f758cad87e29 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:30.499298 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-e52c28ef-4523-4351-a220-f758cad87e29 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:30.499757 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.objects.instance [None req-e52c28ef-4523-4351-a220-f758cad87e29 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lazy-loading 'fault' on Instance uuid 776433f8-bf60-4dc3-a880-ca4852e0efb6 {{(pid=117850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:02:30.522204 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-92ff0c0f-b785-454b-b9ab-451d5e8be19b tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:30.531321 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-92ff0c0f-b785-454b-b9ab-451d5e8be19b tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2" status: 200 len: 1266 microversion: 2.1 time: 0.311384 Jun 16 19:02:30.531915 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 224/422] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:30 2022] GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2 => generated 1266 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:30.563753 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-e52c28ef-4523-4351-a220-f758cad87e29 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e66f41aa3194667bd5970337fd41cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae3331bfc29456c94e309c51cb82a9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:30.571690 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-e52c28ef-4523-4351-a220-f758cad87e29 tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] 10.222.0.70 "GET /compute/v2.1/servers/776433f8-bf60-4dc3-a880-ca4852e0efb6" status: 200 len: 1304 microversion: 2.1 time: 0.163962 Jun 16 19:02:30.572716 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 199/423] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:30 2022] GET /compute/v2.1/servers/776433f8-bf60-4dc3-a880-ca4852e0efb6 => generated 1304 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:02:30.899954 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-515366a5-b5eb-45ea-94b9-e3841bd12864 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:30.901720 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-515366a5-b5eb-45ea-94b9-e3841bd12864 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:30.910401 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-515366a5-b5eb-45ea-94b9-e3841bd12864 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:30.911075 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-515366a5-b5eb-45ea-94b9-e3841bd12864 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:30.912317 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-515366a5-b5eb-45ea-94b9-e3841bd12864 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:30.912963 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-515366a5-b5eb-45ea-94b9-e3841bd12864 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:31.074660 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-9426d0bc-71af-4070-a599-bbc9e0c7c18c tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:31.080352 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-9426d0bc-71af-4070-a599-bbc9e0c7c18c tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:31.093608 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-9426d0bc-71af-4070-a599-bbc9e0c7c18c tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:31.094068 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-9426d0bc-71af-4070-a599-bbc9e0c7c18c tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:31.094883 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-9426d0bc-71af-4070-a599-bbc9e0c7c18c tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:31.095327 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-9426d0bc-71af-4070-a599-bbc9e0c7c18c tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:31.111020 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-515366a5-b5eb-45ea-94b9-e3841bd12864 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:31.121392 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-515366a5-b5eb-45ea-94b9-e3841bd12864 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:31.122987 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-515366a5-b5eb-45ea-94b9-e3841bd12864 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:31.124238 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-515366a5-b5eb-45ea-94b9-e3841bd12864 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1752 microversion: 2.20 time: 0.228442 Jun 16 19:02:31.124804 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 225/424] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:30 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1752 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:02:31.251891 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-9426d0bc-71af-4070-a599-bbc9e0c7c18c tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:31.260061 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-9426d0bc-71af-4070-a599-bbc9e0c7c18c tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1712 microversion: 2.1 time: 0.192417 Jun 16 19:02:31.260638 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 200/425] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:31 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1712 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:02:31.291635 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [req-b6d6204e-dd4e-4806-a18a-e1fbbe56949e req-e6e5475c-0696-4422-a7a1-6bb43a33323a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b99da3e1-cab4-41a0-a1e4-6a29efeb77f2", "tag": "3e69a90c-a36f-422b-a615-de50c8751ec1"}]} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:02:31.300486 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-b6d6204e-dd4e-4806-a18a-e1fbbe56949e req-e6e5475c-0696-4422-a7a1-6bb43a33323a service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:31.301056 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-b6d6204e-dd4e-4806-a18a-e1fbbe56949e req-e6e5475c-0696-4422-a7a1-6bb43a33323a service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:31.312800 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.compute.server_external_events [req-b6d6204e-dd4e-4806-a18a-e1fbbe56949e req-e6e5475c-0696-4422-a7a1-6bb43a33323a service nova] Creating event network-changed:3e69a90c-a36f-422b-a615-de50c8751ec1 for instance b99da3e1-cab4-41a0-a1e4-6a29efeb77f2 on hv-cinder-84617 Jun 16 19:02:31.317938 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [req-b6d6204e-dd4e-4806-a18a-e1fbbe56949e req-e6e5475c-0696-4422-a7a1-6bb43a33323a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030503 Jun 16 19:02:31.318587 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 226/426] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:02:31.547869 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-bf9abbec-9e99-4f9a-80cb-75451faf1ae6 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:31.548625 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-bf9abbec-9e99-4f9a-80cb-75451faf1ae6 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: b99da3e1-cab4-41a0-a1e4-6a29efeb77f2] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:31.558404 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-bf9abbec-9e99-4f9a-80cb-75451faf1ae6 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:31.559265 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-bf9abbec-9e99-4f9a-80cb-75451faf1ae6 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:31.563045 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-bf9abbec-9e99-4f9a-80cb-75451faf1ae6 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:31.563513 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-bf9abbec-9e99-4f9a-80cb-75451faf1ae6 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:31.595220 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-b9ae498d-aa03-4fd4-990e-92f71b4f7b5a tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:31.596483 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-b9ae498d-aa03-4fd4-990e-92f71b4f7b5a tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] [instance: 776433f8-bf60-4dc3-a880-ca4852e0efb6] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:31.605008 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-b9ae498d-aa03-4fd4-990e-92f71b4f7b5a tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:31.605459 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-b9ae498d-aa03-4fd4-990e-92f71b4f7b5a tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:31.606231 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-b9ae498d-aa03-4fd4-990e-92f71b4f7b5a tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:31.606726 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-b9ae498d-aa03-4fd4-990e-92f71b4f7b5a tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:31.625140 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.wsgi [None req-b9ae498d-aa03-4fd4-990e-92f71b4f7b5a tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] HTTP exception thrown: Instance 776433f8-bf60-4dc3-a880-ca4852e0efb6 could not be found. Jun 16 19:02:31.628499 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-b9ae498d-aa03-4fd4-990e-92f71b4f7b5a tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Request method failure captured: Jun 16 19:02:31.628499 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: request: GET /compute/v2.1/servers/776433f8-bf60-4dc3-a880-ca4852e0efb6 HTTP/1.1 Jun 16 19:02:31.628499 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Accept: application/json Jun 16 19:02:31.628499 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Accept-Encoding: identity Jun 16 19:02:31.628499 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Connection: close Jun 16 19:02:31.628499 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Content-Length: 0 Jun 16 19:02:31.628499 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Content-Type: application/json Jun 16 19:02:31.628499 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Host: 10.222.0.70 Jun 16 19:02:31.628499 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Openstack-System-Scope: None Jun 16 19:02:31.628499 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: User-Agent: python-urllib3/1.26.9 Jun 16 19:02:31.628499 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Auth-Token: gAAAAABiq34l9nbMBIrH9xz8-MMJMdqwSrfdy-ifldT1Nk7QJyp_xUwZmAMAQEm0IXUrNIIEU4zCTvGYy8G8ooknJFM6TPqGwVp8q0s9goZMAxS2C1AEf5KSK0VgSPlIdGg3aT4-_PAY8AdmHc2L5iMRRQKS-6GAN5EcQYoLnofeXI9t0ZgouIo Jun 16 19:02:31.628499 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Domain-Id: None Jun 16 19:02:31.628499 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Domain-Name: None Jun 16 19:02:31.628499 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Identity-Status: Confirmed Jun 16 19:02:31.628499 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Is-Admin-Project: True Jun 16 19:02:31.628499 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Domain-Id: default Jun 16 19:02:31.628499 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Domain-Name: Default Jun 16 19:02:31.628499 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Id: bae3331bfc29456c94e309c51cb82a9f Jun 16 19:02:31.628499 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Name: tempest-VolumesNegativeTest-974337072 Jun 16 19:02:31.628499 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Role: member,reader Jun 16 19:02:31.628499 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Roles: member,reader Jun 16 19:02:31.630347 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/bae3331bfc29456c94e309c51cb82a9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_bae3331bfc29456c94e309c51cb82a9f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/bae3331bfc29456c94e309c51cb82a9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/bae3331bfc29456c94e309c51cb82a9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 16 19:02:31.630347 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant: tempest-VolumesNegativeTest-974337072 Jun 16 19:02:31.630347 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant-Id: bae3331bfc29456c94e309c51cb82a9f Jun 16 19:02:31.630347 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant-Name: tempest-VolumesNegativeTest-974337072 Jun 16 19:02:31.630347 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User: tempest-VolumesNegativeTest-974337072-project Jun 16 19:02:31.630347 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Domain-Id: default Jun 16 19:02:31.630347 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Domain-Name: Default Jun 16 19:02:31.630347 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Id: 7e66f41aa3194667bd5970337fd41cfa Jun 16 19:02:31.630347 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Name: tempest-VolumesNegativeTest-974337072-project Jun 16 19:02:31.630347 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: method: > Jun 16 19:02:31.630347 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: exception: Instance 776433f8-bf60-4dc3-a880-ca4852e0efb6 could not be found. Jun 16 19:02:31.630347 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: action_args: {'id': '776433f8-bf60-4dc3-a880-ca4852e0efb6'} Jun 16 19:02:31.631576 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:02:31.631576 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:02:31.631576 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:02:31.631576 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:02:31.631576 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:02:31.631576 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:02:31.631576 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:02:31.631576 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:02:31.631576 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:02:31.631576 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:02:31.631576 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 776433f8-bf60-4dc3-a880-ca4852e0efb6 could not be found. Jun 16 19:02:31.631576 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:02:31.631576 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:02:31.631576 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:02:31.631576 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:02:31.631576 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:02:31.631576 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:02:31.631576 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:02:31.631576 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:02:31.631576 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:02:31.632791 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:02:31.632791 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:02:31.632791 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:02:31.632791 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:02:31.632791 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:02:31.632791 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:02:31.632791 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:02:31.632791 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 776433f8-bf60-4dc3-a880-ca4852e0efb6 could not be found. Jun 16 19:02:31.632791 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:02:31.632791 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:02:31.632791 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:02:31.632791 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:02:31.632791 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:02:31.632791 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:02:31.632791 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:02:31.632791 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:02:31.632791 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 776433f8-bf60-4dc3-a880-ca4852e0efb6 could not be found. Jun 16 19:02:31.632791 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:02:31.638122 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-b9ae498d-aa03-4fd4-990e-92f71b4f7b5a tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] Returning 404 to user: Instance 776433f8-bf60-4dc3-a880-ca4852e0efb6 could not be found. {{(pid=117852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:02:31.640600 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-b9ae498d-aa03-4fd4-990e-92f71b4f7b5a tempest-VolumesNegativeTest-974337072 tempest-VolumesNegativeTest-974337072-project] 10.222.0.70 "GET /compute/v2.1/servers/776433f8-bf60-4dc3-a880-ca4852e0efb6" status: 404 len: 111 microversion: 2.1 time: 0.051487 Jun 16 19:02:31.643607 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 227/427] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:31 2022] GET /compute/v2.1/servers/776433f8-bf60-4dc3-a880-ca4852e0efb6 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:02:31.763653 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-bf9abbec-9e99-4f9a-80cb-75451faf1ae6 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:31.772972 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-bf9abbec-9e99-4f9a-80cb-75451faf1ae6 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2" status: 200 len: 1266 microversion: 2.1 time: 0.228822 Jun 16 19:02:31.779409 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 201/428] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:31 2022] GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2 => generated 1266 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:32.147595 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-81b59e8d-de75-41a0-b98e-86430473f475 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:32.148460 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-81b59e8d-de75-41a0-b98e-86430473f475 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:32.158507 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-81b59e8d-de75-41a0-b98e-86430473f475 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:32.159338 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-81b59e8d-de75-41a0-b98e-86430473f475 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:32.160909 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-81b59e8d-de75-41a0-b98e-86430473f475 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:32.161943 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-81b59e8d-de75-41a0-b98e-86430473f475 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:32.333964 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-81b59e8d-de75-41a0-b98e-86430473f475 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:32.344091 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-81b59e8d-de75-41a0-b98e-86430473f475 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:32.346545 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-81b59e8d-de75-41a0-b98e-86430473f475 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:32.348025 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-81b59e8d-de75-41a0-b98e-86430473f475 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1808 microversion: 2.20 time: 0.209212 Jun 16 19:02:32.348873 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 228/429] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:32 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1808 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:02:32.798211 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-a628dfaf-1c62-4ebb-a77a-19c541be1714 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:32.798941 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-a628dfaf-1c62-4ebb-a77a-19c541be1714 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: b99da3e1-cab4-41a0-a1e4-6a29efeb77f2] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:32.805765 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_cell0:SELECT=2 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:02:32.807043 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_cell0:SELECT=8 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:02:32.820682 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-a628dfaf-1c62-4ebb-a77a-19c541be1714 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:32.821133 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-a628dfaf-1c62-4ebb-a77a-19c541be1714 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:32.822142 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-a628dfaf-1c62-4ebb-a77a-19c541be1714 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:32.832817 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-a628dfaf-1c62-4ebb-a77a-19c541be1714 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:33.001667 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-a628dfaf-1c62-4ebb-a77a-19c541be1714 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:33.011742 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-a628dfaf-1c62-4ebb-a77a-19c541be1714 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2" status: 200 len: 1266 microversion: 2.1 time: 0.220586 Jun 16 19:02:33.012494 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 202/430] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:32 2022] GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2 => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:33.376910 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-13afa273-38e8-4f6e-8aea-288aa34fb0ac tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:33.378359 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-13afa273-38e8-4f6e-8aea-288aa34fb0ac tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:33.393700 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-13afa273-38e8-4f6e-8aea-288aa34fb0ac tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:33.394387 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-13afa273-38e8-4f6e-8aea-288aa34fb0ac tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:33.395966 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-13afa273-38e8-4f6e-8aea-288aa34fb0ac tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:33.396624 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-13afa273-38e8-4f6e-8aea-288aa34fb0ac tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:33.624587 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-13afa273-38e8-4f6e-8aea-288aa34fb0ac tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:33.638261 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-13afa273-38e8-4f6e-8aea-288aa34fb0ac tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:33.640666 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-13afa273-38e8-4f6e-8aea-288aa34fb0ac tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:33.642676 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-13afa273-38e8-4f6e-8aea-288aa34fb0ac tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1808 microversion: 2.20 time: 0.278903 Jun 16 19:02:33.643943 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 229/431] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:33 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1808 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:02:34.030903 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-418369c2-21e7-4488-b72e-f40fa97ad6b6 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:34.032159 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-418369c2-21e7-4488-b72e-f40fa97ad6b6 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: b99da3e1-cab4-41a0-a1e4-6a29efeb77f2] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:34.041315 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-418369c2-21e7-4488-b72e-f40fa97ad6b6 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:34.042758 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-418369c2-21e7-4488-b72e-f40fa97ad6b6 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:34.043842 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-418369c2-21e7-4488-b72e-f40fa97ad6b6 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:34.044540 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-418369c2-21e7-4488-b72e-f40fa97ad6b6 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:34.198912 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-418369c2-21e7-4488-b72e-f40fa97ad6b6 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:34.206749 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-418369c2-21e7-4488-b72e-f40fa97ad6b6 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2" status: 200 len: 1266 microversion: 2.1 time: 0.181620 Jun 16 19:02:34.207309 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 203/432] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:34 2022] GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2 => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:34.666066 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-f67289a1-230e-4c74-b5e9-c3ffe3e929b0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:34.667560 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-f67289a1-230e-4c74-b5e9-c3ffe3e929b0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:34.674355 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f67289a1-230e-4c74-b5e9-c3ffe3e929b0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:34.674840 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f67289a1-230e-4c74-b5e9-c3ffe3e929b0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:34.675621 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f67289a1-230e-4c74-b5e9-c3ffe3e929b0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:34.676082 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f67289a1-230e-4c74-b5e9-c3ffe3e929b0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:34.836915 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-f67289a1-230e-4c74-b5e9-c3ffe3e929b0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:34.848110 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-f67289a1-230e-4c74-b5e9-c3ffe3e929b0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:34.849650 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-f67289a1-230e-4c74-b5e9-c3ffe3e929b0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:34.851031 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-f67289a1-230e-4c74-b5e9-c3ffe3e929b0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1808 microversion: 2.20 time: 0.189329 Jun 16 19:02:34.854627 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 230/433] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:34 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1808 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:02:35.224254 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-1f6e3955-edc7-4ffe-8e3c-b774f0a050f6 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:35.224894 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-1f6e3955-edc7-4ffe-8e3c-b774f0a050f6 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: b99da3e1-cab4-41a0-a1e4-6a29efeb77f2] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:35.233268 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-1f6e3955-edc7-4ffe-8e3c-b774f0a050f6 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:35.234048 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-1f6e3955-edc7-4ffe-8e3c-b774f0a050f6 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:35.235002 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-1f6e3955-edc7-4ffe-8e3c-b774f0a050f6 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:35.235782 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-1f6e3955-edc7-4ffe-8e3c-b774f0a050f6 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:35.480797 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-1f6e3955-edc7-4ffe-8e3c-b774f0a050f6 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:35.489727 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-1f6e3955-edc7-4ffe-8e3c-b774f0a050f6 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2" status: 200 len: 1266 microversion: 2.1 time: 0.269350 Jun 16 19:02:35.490519 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 204/434] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:35 2022] GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2 => generated 1266 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:35.871454 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-e91c82e2-08d5-4e81-9a57-b94c65b3042f tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:35.872053 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-e91c82e2-08d5-4e81-9a57-b94c65b3042f tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:35.883243 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-e91c82e2-08d5-4e81-9a57-b94c65b3042f tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:35.883696 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-e91c82e2-08d5-4e81-9a57-b94c65b3042f tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:35.885093 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-e91c82e2-08d5-4e81-9a57-b94c65b3042f tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:35.885588 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-e91c82e2-08d5-4e81-9a57-b94c65b3042f tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:36.036447 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-e91c82e2-08d5-4e81-9a57-b94c65b3042f tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:36.046801 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-e91c82e2-08d5-4e81-9a57-b94c65b3042f tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:36.048311 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-e91c82e2-08d5-4e81-9a57-b94c65b3042f tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:36.049516 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-e91c82e2-08d5-4e81-9a57-b94c65b3042f tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1808 microversion: 2.20 time: 0.182778 Jun 16 19:02:36.050428 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 231/435] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:35 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1808 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:02:36.507359 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-c7fac0b0-5bee-4a80-b7db-876a85299013 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:36.507955 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-c7fac0b0-5bee-4a80-b7db-876a85299013 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: b99da3e1-cab4-41a0-a1e4-6a29efeb77f2] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:36.514991 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-c7fac0b0-5bee-4a80-b7db-876a85299013 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:36.515442 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-c7fac0b0-5bee-4a80-b7db-876a85299013 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:36.516205 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-c7fac0b0-5bee-4a80-b7db-876a85299013 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:36.516816 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-c7fac0b0-5bee-4a80-b7db-876a85299013 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:36.917606 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-c7fac0b0-5bee-4a80-b7db-876a85299013 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:36.925768 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-c7fac0b0-5bee-4a80-b7db-876a85299013 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2" status: 200 len: 1266 microversion: 2.1 time: 0.422345 Jun 16 19:02:36.926550 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 205/436] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:36 2022] GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2 => generated 1266 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:37.074800 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-d5f2ddcd-62fd-4cae-8cbd-6e2bbe1dfd23 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:37.075684 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-d5f2ddcd-62fd-4cae-8cbd-6e2bbe1dfd23 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:37.098647 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d5f2ddcd-62fd-4cae-8cbd-6e2bbe1dfd23 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:37.099108 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d5f2ddcd-62fd-4cae-8cbd-6e2bbe1dfd23 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:37.099932 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d5f2ddcd-62fd-4cae-8cbd-6e2bbe1dfd23 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:37.100379 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d5f2ddcd-62fd-4cae-8cbd-6e2bbe1dfd23 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:37.327387 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-d5f2ddcd-62fd-4cae-8cbd-6e2bbe1dfd23 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:37.336413 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-d5f2ddcd-62fd-4cae-8cbd-6e2bbe1dfd23 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:37.340565 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-d5f2ddcd-62fd-4cae-8cbd-6e2bbe1dfd23 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:37.342180 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-d5f2ddcd-62fd-4cae-8cbd-6e2bbe1dfd23 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1808 microversion: 2.20 time: 0.275964 Jun 16 19:02:37.343456 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 232/437] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:37 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1808 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:02:37.954247 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-4a73d2e7-da44-4ae6-a32c-3ed5c5bd7cd5 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:37.954882 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-4a73d2e7-da44-4ae6-a32c-3ed5c5bd7cd5 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: b99da3e1-cab4-41a0-a1e4-6a29efeb77f2] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:37.963138 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-4a73d2e7-da44-4ae6-a32c-3ed5c5bd7cd5 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:37.963649 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-4a73d2e7-da44-4ae6-a32c-3ed5c5bd7cd5 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:37.964486 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-4a73d2e7-da44-4ae6-a32c-3ed5c5bd7cd5 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:37.964922 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-4a73d2e7-da44-4ae6-a32c-3ed5c5bd7cd5 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:38.118986 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-4a73d2e7-da44-4ae6-a32c-3ed5c5bd7cd5 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:38.126868 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-4a73d2e7-da44-4ae6-a32c-3ed5c5bd7cd5 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2" status: 200 len: 1266 microversion: 2.1 time: 0.185999 Jun 16 19:02:38.127475 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 206/438] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:37 2022] GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2 => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:38.361827 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-fd4fcfdb-338b-40e0-8013-1baf55fd69b0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:38.362531 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-fd4fcfdb-338b-40e0-8013-1baf55fd69b0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:38.372479 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-fd4fcfdb-338b-40e0-8013-1baf55fd69b0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:38.372936 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-fd4fcfdb-338b-40e0-8013-1baf55fd69b0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:38.373757 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-fd4fcfdb-338b-40e0-8013-1baf55fd69b0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:38.374373 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-fd4fcfdb-338b-40e0-8013-1baf55fd69b0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:38.589860 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-fd4fcfdb-338b-40e0-8013-1baf55fd69b0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:38.599258 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-fd4fcfdb-338b-40e0-8013-1baf55fd69b0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:38.607922 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-fd4fcfdb-338b-40e0-8013-1baf55fd69b0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:38.610234 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-fd4fcfdb-338b-40e0-8013-1baf55fd69b0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1808 microversion: 2.20 time: 0.252285 Jun 16 19:02:38.611563 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 233/439] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:38 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1808 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:02:39.153788 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-f19dfa45-f083-496f-bfbd-5a90c4bac011 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:39.154417 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-f19dfa45-f083-496f-bfbd-5a90c4bac011 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: b99da3e1-cab4-41a0-a1e4-6a29efeb77f2] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:39.164628 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-f19dfa45-f083-496f-bfbd-5a90c4bac011 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:39.165943 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-f19dfa45-f083-496f-bfbd-5a90c4bac011 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:39.167837 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-f19dfa45-f083-496f-bfbd-5a90c4bac011 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:39.168302 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-f19dfa45-f083-496f-bfbd-5a90c4bac011 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:39.335253 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-f19dfa45-f083-496f-bfbd-5a90c4bac011 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:39.368966 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-f19dfa45-f083-496f-bfbd-5a90c4bac011 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2" status: 200 len: 1266 microversion: 2.1 time: 0.219239 Jun 16 19:02:39.380339 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 207/440] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:39 2022] GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2 => generated 1266 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:39.629637 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-84d4b0be-41a3-4fd5-84fc-750571430649 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:39.630285 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-84d4b0be-41a3-4fd5-84fc-750571430649 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:39.646899 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-84d4b0be-41a3-4fd5-84fc-750571430649 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:39.647365 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-84d4b0be-41a3-4fd5-84fc-750571430649 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:39.648225 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-84d4b0be-41a3-4fd5-84fc-750571430649 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:39.648671 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-84d4b0be-41a3-4fd5-84fc-750571430649 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:39.863696 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-84d4b0be-41a3-4fd5-84fc-750571430649 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:39.875993 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-84d4b0be-41a3-4fd5-84fc-750571430649 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:39.877829 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-84d4b0be-41a3-4fd5-84fc-750571430649 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:39.880983 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-84d4b0be-41a3-4fd5-84fc-750571430649 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1808 microversion: 2.20 time: 0.254840 Jun 16 19:02:39.882184 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 234/441] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:39 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1808 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:02:40.386720 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-aa05d296-92a9-4dfb-b00b-2b55e184d874 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:40.388223 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-aa05d296-92a9-4dfb-b00b-2b55e184d874 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: b99da3e1-cab4-41a0-a1e4-6a29efeb77f2] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:40.395519 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-aa05d296-92a9-4dfb-b00b-2b55e184d874 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:40.396096 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-aa05d296-92a9-4dfb-b00b-2b55e184d874 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:40.396962 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-aa05d296-92a9-4dfb-b00b-2b55e184d874 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:40.397493 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-aa05d296-92a9-4dfb-b00b-2b55e184d874 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:40.608343 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-aa05d296-92a9-4dfb-b00b-2b55e184d874 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:40.617132 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-aa05d296-92a9-4dfb-b00b-2b55e184d874 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2" status: 200 len: 1266 microversion: 2.1 time: 0.234316 Jun 16 19:02:40.617937 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 208/442] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:40 2022] GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2 => generated 1266 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:40.907722 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-21a90ad5-7fb0-4e33-b8d7-7d166a497ea3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:40.908514 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-21a90ad5-7fb0-4e33-b8d7-7d166a497ea3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:40.917764 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-21a90ad5-7fb0-4e33-b8d7-7d166a497ea3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:40.918613 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-21a90ad5-7fb0-4e33-b8d7-7d166a497ea3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:40.919736 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-21a90ad5-7fb0-4e33-b8d7-7d166a497ea3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:40.920394 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-21a90ad5-7fb0-4e33-b8d7-7d166a497ea3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:40.925152 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:02:40.986285 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-ff3cc445-2eb3-4e29-a752-224e0a13b764 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1562294594", "imageRef": "1d993e69-7f01-4fe0-ba52-0eae2fa43ddf", "flavorRef": "452", "networks": [{"uuid": "8c0c065d-4908-43d1-a3e5-02e5697fbcd6"}]}} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:02:41.089830 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.network.neutron [None req-ff3cc445-2eb3-4e29-a752-224e0a13b764 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] validate_networks() for [('8c0c065d-4908-43d1-a3e5-02e5697fbcd6', None, None, None, None, None)] {{(pid=117850) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:02:41.120075 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-21a90ad5-7fb0-4e33-b8d7-7d166a497ea3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:41.131684 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-21a90ad5-7fb0-4e33-b8d7-7d166a497ea3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:41.134375 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-21a90ad5-7fb0-4e33-b8d7-7d166a497ea3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:41.135614 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-21a90ad5-7fb0-4e33-b8d7-7d166a497ea3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1808 microversion: 2.20 time: 0.232986 Jun 16 19:02:41.136178 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 235/443] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:40 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1808 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:02:41.635307 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-59d838af-5ff4-42cb-9c2c-e918d819192e tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:41.635911 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-59d838af-5ff4-42cb-9c2c-e918d819192e tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: b99da3e1-cab4-41a0-a1e4-6a29efeb77f2] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:41.643743 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-ff3cc445-2eb3-4e29-a752-224e0a13b764 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Flavor limits 0:0:0 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:02:41.645723 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-ff3cc445-2eb3-4e29-a752-224e0a13b764 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Image limits 0:0:0 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:02:41.647226 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-ff3cc445-2eb3-4e29-a752-224e0a13b764 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Flavor pref 0:0:0 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:02:41.648200 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-ff3cc445-2eb3-4e29-a752-224e0a13b764 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Image pref 0:0:0 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:02:41.649169 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-ff3cc445-2eb3-4e29-a752-224e0a13b764 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:02:41.651642 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-59d838af-5ff4-42cb-9c2c-e918d819192e tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:41.652101 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-59d838af-5ff4-42cb-9c2c-e918d819192e tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:41.652890 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-59d838af-5ff4-42cb-9c2c-e918d819192e tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:41.653329 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-59d838af-5ff4-42cb-9c2c-e918d819192e tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:41.663675 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-ff3cc445-2eb3-4e29-a752-224e0a13b764 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:41.664645 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-ff3cc445-2eb3-4e29-a752-224e0a13b764 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:41.667237 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-ff3cc445-2eb3-4e29-a752-224e0a13b764 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:41.668052 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-ff3cc445-2eb3-4e29-a752-224e0a13b764 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:41.691428 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.quota [None req-ff3cc445-2eb3-4e29-a752-224e0a13b764 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Getting quotas for project ddb2c879d7f44189ab76e377c33f5e35. Resources: {'cores', 'ram', 'instances'} {{(pid=117850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:02:41.696276 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.quota [None req-ff3cc445-2eb3-4e29-a752-224e0a13b764 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Getting quotas for user fb08a57a393d4c8591da42cd5e92aca9 and project ddb2c879d7f44189ab76e377c33f5e35. Resources: {'cores', 'ram', 'instances'} {{(pid=117850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:02:41.708763 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-ff3cc445-2eb3-4e29-a752-224e0a13b764 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Going to run 1 instances... {{(pid=117850) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:02:41.711419 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-ff3cc445-2eb3-4e29-a752-224e0a13b764 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] [instance: 1e7cb911-e703-4b7d-98b6-18e49fe78d2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1d993e69-7f01-4fe0-ba52-0eae2fa43ddf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:02:41.785914 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-ff3cc445-2eb3-4e29-a752-224e0a13b764 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.805191 Jun 16 19:02:41.786605 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 209/444] 10.222.0.70 () {60 vars in 1146 bytes} [Thu Jun 16 19:02:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 808 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:02:41.797840 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-d97d6cb0-924d-43c7-bfd6-c9481b0b5407 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:41.798487 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-d97d6cb0-924d-43c7-bfd6-c9481b0b5407 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] [instance: 1e7cb911-e703-4b7d-98b6-18e49fe78d2e] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:41.898008 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-d97d6cb0-924d-43c7-bfd6-c9481b0b5407 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb08a57a393d4c8591da42cd5e92aca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c879d7f44189ab76e377c33f5e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:41.923277 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-d97d6cb0-924d-43c7-bfd6-c9481b0b5407 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] 10.222.0.70 "GET /compute/v2.1/servers/1e7cb911-e703-4b7d-98b6-18e49fe78d2e" status: 200 len: 1219 microversion: 2.1 time: 0.129455 Jun 16 19:02:41.936081 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 210/445] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:41 2022] GET /compute/v2.1/servers/1e7cb911-e703-4b7d-98b6-18e49fe78d2e => generated 1219 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:02:41.985320 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-59d838af-5ff4-42cb-9c2c-e918d819192e tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:41.996454 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-59d838af-5ff4-42cb-9c2c-e918d819192e tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2" status: 200 len: 1266 microversion: 2.1 time: 0.365524 Jun 16 19:02:41.997335 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 236/446] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:41 2022] GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2 => generated 1266 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:02:42.155385 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-7eb77d21-916a-4cc6-a0fe-dfc950005d23 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:42.156348 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-7eb77d21-916a-4cc6-a0fe-dfc950005d23 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:42.167704 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-7eb77d21-916a-4cc6-a0fe-dfc950005d23 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:42.174215 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-7eb77d21-916a-4cc6-a0fe-dfc950005d23 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:42.175390 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-7eb77d21-916a-4cc6-a0fe-dfc950005d23 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:42.178102 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-7eb77d21-916a-4cc6-a0fe-dfc950005d23 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:42.406628 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-7eb77d21-916a-4cc6-a0fe-dfc950005d23 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:42.414886 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-7eb77d21-916a-4cc6-a0fe-dfc950005d23 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:42.417447 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-7eb77d21-916a-4cc6-a0fe-dfc950005d23 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:42.419683 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-7eb77d21-916a-4cc6-a0fe-dfc950005d23 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1808 microversion: 2.20 time: 0.269829 Jun 16 19:02:42.433655 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 211/447] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:42 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1808 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:02:42.941694 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-21433553-0692-4840-9250-950238d3b400 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:42.942377 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-21433553-0692-4840-9250-950238d3b400 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] [instance: 1e7cb911-e703-4b7d-98b6-18e49fe78d2e] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:42.950686 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-21433553-0692-4840-9250-950238d3b400 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:42.951418 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-21433553-0692-4840-9250-950238d3b400 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:42.953101 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-21433553-0692-4840-9250-950238d3b400 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:42.953549 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-21433553-0692-4840-9250-950238d3b400 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:43.014203 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-d89f8851-c8aa-41f4-a43c-be4249f2c30f tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:43.014829 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-d89f8851-c8aa-41f4-a43c-be4249f2c30f tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: b99da3e1-cab4-41a0-a1e4-6a29efeb77f2] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:43.027452 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d89f8851-c8aa-41f4-a43c-be4249f2c30f tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:43.028678 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d89f8851-c8aa-41f4-a43c-be4249f2c30f tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:43.032160 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d89f8851-c8aa-41f4-a43c-be4249f2c30f tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:43.032632 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d89f8851-c8aa-41f4-a43c-be4249f2c30f tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:43.045277 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-21433553-0692-4840-9250-950238d3b400 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb08a57a393d4c8591da42cd5e92aca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c879d7f44189ab76e377c33f5e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:43.052981 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-21433553-0692-4840-9250-950238d3b400 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] 10.222.0.70 "GET /compute/v2.1/servers/1e7cb911-e703-4b7d-98b6-18e49fe78d2e" status: 200 len: 1223 microversion: 2.1 time: 0.115327 Jun 16 19:02:43.053551 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 237/448] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:42 2022] GET /compute/v2.1/servers/1e7cb911-e703-4b7d-98b6-18e49fe78d2e => generated 1223 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:43.209044 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-d89f8851-c8aa-41f4-a43c-be4249f2c30f tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:43.216720 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-d89f8851-c8aa-41f4-a43c-be4249f2c30f tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2" status: 200 len: 1266 microversion: 2.1 time: 0.206845 Jun 16 19:02:43.217289 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 212/449] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:43 2022] GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2 => generated 1266 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:43.452002 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-cb7414b8-ec77-4a17-a567-4b5506b402ac tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:43.453127 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-cb7414b8-ec77-4a17-a567-4b5506b402ac tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:43.460620 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-cb7414b8-ec77-4a17-a567-4b5506b402ac tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:43.460620 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-cb7414b8-ec77-4a17-a567-4b5506b402ac tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:43.461090 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-cb7414b8-ec77-4a17-a567-4b5506b402ac tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:43.461520 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-cb7414b8-ec77-4a17-a567-4b5506b402ac tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:43.629660 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-cb7414b8-ec77-4a17-a567-4b5506b402ac tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:43.639010 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-cb7414b8-ec77-4a17-a567-4b5506b402ac tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:43.640737 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-cb7414b8-ec77-4a17-a567-4b5506b402ac tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:43.641911 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-cb7414b8-ec77-4a17-a567-4b5506b402ac tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1808 microversion: 2.20 time: 0.205081 Jun 16 19:02:43.642487 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 238/450] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:43 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1808 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:02:44.071004 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-b83fd614-906c-4b7d-aa0d-da66b771190d tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:44.071932 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-b83fd614-906c-4b7d-aa0d-da66b771190d tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] [instance: 1e7cb911-e703-4b7d-98b6-18e49fe78d2e] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:44.079074 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b83fd614-906c-4b7d-aa0d-da66b771190d tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:44.079523 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b83fd614-906c-4b7d-aa0d-da66b771190d tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:44.080293 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b83fd614-906c-4b7d-aa0d-da66b771190d tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:44.080835 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b83fd614-906c-4b7d-aa0d-da66b771190d tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:44.153956 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-b83fd614-906c-4b7d-aa0d-da66b771190d tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb08a57a393d4c8591da42cd5e92aca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c879d7f44189ab76e377c33f5e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:44.161586 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-b83fd614-906c-4b7d-aa0d-da66b771190d tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] 10.222.0.70 "GET /compute/v2.1/servers/1e7cb911-e703-4b7d-98b6-18e49fe78d2e" status: 200 len: 1223 microversion: 2.1 time: 0.094564 Jun 16 19:02:44.162161 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 213/451] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:44 2022] GET /compute/v2.1/servers/1e7cb911-e703-4b7d-98b6-18e49fe78d2e => generated 1223 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:44.233970 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-26555b31-c170-4b88-907b-bdc5411b3de4 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:44.234555 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-26555b31-c170-4b88-907b-bdc5411b3de4 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: b99da3e1-cab4-41a0-a1e4-6a29efeb77f2] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:44.242168 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-26555b31-c170-4b88-907b-bdc5411b3de4 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:44.242792 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-26555b31-c170-4b88-907b-bdc5411b3de4 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:44.243792 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-26555b31-c170-4b88-907b-bdc5411b3de4 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:44.243792 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-26555b31-c170-4b88-907b-bdc5411b3de4 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:44.399463 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-26555b31-c170-4b88-907b-bdc5411b3de4 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:44.408359 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-26555b31-c170-4b88-907b-bdc5411b3de4 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2" status: 200 len: 1266 microversion: 2.1 time: 0.178506 Jun 16 19:02:44.408939 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 239/452] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:44 2022] GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:44.661290 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-cb5f6af9-c22f-40a1-9f9f-da3376dd17e2 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:44.662023 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-cb5f6af9-c22f-40a1-9f9f-da3376dd17e2 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:44.670846 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-cb5f6af9-c22f-40a1-9f9f-da3376dd17e2 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:44.671347 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-cb5f6af9-c22f-40a1-9f9f-da3376dd17e2 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:44.672706 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-cb5f6af9-c22f-40a1-9f9f-da3376dd17e2 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:44.673673 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-cb5f6af9-c22f-40a1-9f9f-da3376dd17e2 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:44.819630 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-cb5f6af9-c22f-40a1-9f9f-da3376dd17e2 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:44.830081 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-cb5f6af9-c22f-40a1-9f9f-da3376dd17e2 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:44.831614 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-cb5f6af9-c22f-40a1-9f9f-da3376dd17e2 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:44.832777 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-cb5f6af9-c22f-40a1-9f9f-da3376dd17e2 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1808 microversion: 2.20 time: 0.175457 Jun 16 19:02:44.833337 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 214/453] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:44 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:02:45.181359 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-9ff83406-05c5-4b51-86b1-054b3962f7fd tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:45.182703 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-9ff83406-05c5-4b51-86b1-054b3962f7fd tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] [instance: 1e7cb911-e703-4b7d-98b6-18e49fe78d2e] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:45.196888 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-9ff83406-05c5-4b51-86b1-054b3962f7fd tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:45.198136 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-9ff83406-05c5-4b51-86b1-054b3962f7fd tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:45.199289 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-9ff83406-05c5-4b51-86b1-054b3962f7fd tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:45.199998 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-9ff83406-05c5-4b51-86b1-054b3962f7fd tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:45.297751 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-9ff83406-05c5-4b51-86b1-054b3962f7fd tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb08a57a393d4c8591da42cd5e92aca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c879d7f44189ab76e377c33f5e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:45.307915 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-9ff83406-05c5-4b51-86b1-054b3962f7fd tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] 10.222.0.70 "GET /compute/v2.1/servers/1e7cb911-e703-4b7d-98b6-18e49fe78d2e" status: 200 len: 1223 microversion: 2.1 time: 0.133016 Jun 16 19:02:45.318606 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 240/454] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:45 2022] GET /compute/v2.1/servers/1e7cb911-e703-4b7d-98b6-18e49fe78d2e => generated 1223 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:45.426020 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-37b2827d-2725-45c5-9003-fd28f65117eb tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:45.426864 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-37b2827d-2725-45c5-9003-fd28f65117eb tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: b99da3e1-cab4-41a0-a1e4-6a29efeb77f2] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:45.434401 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-37b2827d-2725-45c5-9003-fd28f65117eb tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:45.434979 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-37b2827d-2725-45c5-9003-fd28f65117eb tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:45.435812 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-37b2827d-2725-45c5-9003-fd28f65117eb tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:45.436314 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-37b2827d-2725-45c5-9003-fd28f65117eb tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:45.579334 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-37b2827d-2725-45c5-9003-fd28f65117eb tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:45.588514 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-37b2827d-2725-45c5-9003-fd28f65117eb tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2" status: 200 len: 1266 microversion: 2.1 time: 0.166206 Jun 16 19:02:45.590725 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 215/455] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:45 2022] GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:02:45.853848 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-feeb45c2-35c5-44b1-9273-425726027715 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:45.854496 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-feeb45c2-35c5-44b1-9273-425726027715 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:45.860607 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-feeb45c2-35c5-44b1-9273-425726027715 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:45.861100 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-feeb45c2-35c5-44b1-9273-425726027715 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:45.861865 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-feeb45c2-35c5-44b1-9273-425726027715 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:45.862261 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-feeb45c2-35c5-44b1-9273-425726027715 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:46.011575 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-feeb45c2-35c5-44b1-9273-425726027715 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:46.020110 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-feeb45c2-35c5-44b1-9273-425726027715 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:46.021599 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-feeb45c2-35c5-44b1-9273-425726027715 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:46.022799 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-feeb45c2-35c5-44b1-9273-425726027715 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1808 microversion: 2.20 time: 0.173934 Jun 16 19:02:46.023348 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 241/456] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:45 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:02:46.325004 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-d58cecc0-4157-4eba-bb87-83d05d5b1da6 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:46.325625 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-d58cecc0-4157-4eba-bb87-83d05d5b1da6 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] [instance: 1e7cb911-e703-4b7d-98b6-18e49fe78d2e] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:46.331753 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d58cecc0-4157-4eba-bb87-83d05d5b1da6 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:46.332203 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d58cecc0-4157-4eba-bb87-83d05d5b1da6 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:46.332966 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d58cecc0-4157-4eba-bb87-83d05d5b1da6 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:46.333398 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d58cecc0-4157-4eba-bb87-83d05d5b1da6 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:46.399097 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-d58cecc0-4157-4eba-bb87-83d05d5b1da6 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb08a57a393d4c8591da42cd5e92aca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c879d7f44189ab76e377c33f5e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:46.408915 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-d58cecc0-4157-4eba-bb87-83d05d5b1da6 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] 10.222.0.70 "GET /compute/v2.1/servers/1e7cb911-e703-4b7d-98b6-18e49fe78d2e" status: 200 len: 1223 microversion: 2.1 time: 0.088441 Jun 16 19:02:46.409513 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 216/457] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:46 2022] GET /compute/v2.1/servers/1e7cb911-e703-4b7d-98b6-18e49fe78d2e => generated 1223 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:46.605804 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-c655b76a-f0d5-4c71-b39a-97e951dffd80 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:46.606481 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-c655b76a-f0d5-4c71-b39a-97e951dffd80 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: b99da3e1-cab4-41a0-a1e4-6a29efeb77f2] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:46.610462 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:02:46.613918 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-c655b76a-f0d5-4c71-b39a-97e951dffd80 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:46.614584 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-c655b76a-f0d5-4c71-b39a-97e951dffd80 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:46.615576 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-c655b76a-f0d5-4c71-b39a-97e951dffd80 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:46.616204 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-c655b76a-f0d5-4c71-b39a-97e951dffd80 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:46.761548 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-c655b76a-f0d5-4c71-b39a-97e951dffd80 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:46.769351 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-c655b76a-f0d5-4c71-b39a-97e951dffd80 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2" status: 200 len: 1266 microversion: 2.1 time: 0.168024 Jun 16 19:02:46.769910 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 242/458] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:46 2022] GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:47.043631 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-8551b32b-ed49-44fc-b640-41aa74297004 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:47.044266 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-8551b32b-ed49-44fc-b640-41aa74297004 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:47.052619 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-8551b32b-ed49-44fc-b640-41aa74297004 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:47.053092 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-8551b32b-ed49-44fc-b640-41aa74297004 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:47.055336 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-8551b32b-ed49-44fc-b640-41aa74297004 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:47.055954 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-8551b32b-ed49-44fc-b640-41aa74297004 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:47.058996 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_cell1:SELECT=100 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:02:47.218062 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-8551b32b-ed49-44fc-b640-41aa74297004 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:47.228632 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-8551b32b-ed49-44fc-b640-41aa74297004 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:47.231068 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-8551b32b-ed49-44fc-b640-41aa74297004 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:47.232335 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-8551b32b-ed49-44fc-b640-41aa74297004 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1808 microversion: 2.20 time: 0.193636 Jun 16 19:02:47.232938 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 217/459] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:47 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1808 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:02:47.426374 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-60675c37-7853-46a4-8170-a42676dcc041 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:47.427110 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-60675c37-7853-46a4-8170-a42676dcc041 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] [instance: 1e7cb911-e703-4b7d-98b6-18e49fe78d2e] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:47.433749 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-60675c37-7853-46a4-8170-a42676dcc041 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:47.434253 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-60675c37-7853-46a4-8170-a42676dcc041 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:47.435293 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-60675c37-7853-46a4-8170-a42676dcc041 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:47.435755 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-60675c37-7853-46a4-8170-a42676dcc041 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:47.504465 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-60675c37-7853-46a4-8170-a42676dcc041 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb08a57a393d4c8591da42cd5e92aca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c879d7f44189ab76e377c33f5e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:47.514365 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-60675c37-7853-46a4-8170-a42676dcc041 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] 10.222.0.70 "GET /compute/v2.1/servers/1e7cb911-e703-4b7d-98b6-18e49fe78d2e" status: 200 len: 1215 microversion: 2.1 time: 0.092018 Jun 16 19:02:47.514983 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 243/460] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:47 2022] GET /compute/v2.1/servers/1e7cb911-e703-4b7d-98b6-18e49fe78d2e => generated 1215 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:47.786765 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-4a461c31-b691-43cf-b003-bd20c4ceba37 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:47.787620 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-4a461c31-b691-43cf-b003-bd20c4ceba37 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: b99da3e1-cab4-41a0-a1e4-6a29efeb77f2] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:47.797170 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-4a461c31-b691-43cf-b003-bd20c4ceba37 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:47.797925 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-4a461c31-b691-43cf-b003-bd20c4ceba37 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:47.799556 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-4a461c31-b691-43cf-b003-bd20c4ceba37 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:47.800552 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-4a461c31-b691-43cf-b003-bd20c4ceba37 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:47.953372 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-4a461c31-b691-43cf-b003-bd20c4ceba37 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:47.961403 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-4a461c31-b691-43cf-b003-bd20c4ceba37 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2" status: 200 len: 1266 microversion: 2.1 time: 0.178505 Jun 16 19:02:47.963255 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 218/461] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:47 2022] GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2 => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:48.251320 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-209f3f20-1426-41f5-90ff-a706879ac17f tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:48.252711 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-209f3f20-1426-41f5-90ff-a706879ac17f tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:48.269141 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-209f3f20-1426-41f5-90ff-a706879ac17f tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:48.269580 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-209f3f20-1426-41f5-90ff-a706879ac17f tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:48.273056 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-209f3f20-1426-41f5-90ff-a706879ac17f tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:48.273517 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-209f3f20-1426-41f5-90ff-a706879ac17f tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:48.532743 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-f53d0b6b-e421-48c8-afb2-31606f72c48f tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:48.533359 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-f53d0b6b-e421-48c8-afb2-31606f72c48f tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] [instance: 1e7cb911-e703-4b7d-98b6-18e49fe78d2e] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:48.539959 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-f53d0b6b-e421-48c8-afb2-31606f72c48f tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:48.541098 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-f53d0b6b-e421-48c8-afb2-31606f72c48f tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:48.542074 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-f53d0b6b-e421-48c8-afb2-31606f72c48f tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:48.542513 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-f53d0b6b-e421-48c8-afb2-31606f72c48f tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:48.610693 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-f53d0b6b-e421-48c8-afb2-31606f72c48f tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb08a57a393d4c8591da42cd5e92aca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c879d7f44189ab76e377c33f5e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:48.623653 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-f53d0b6b-e421-48c8-afb2-31606f72c48f tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] 10.222.0.70 "GET /compute/v2.1/servers/1e7cb911-e703-4b7d-98b6-18e49fe78d2e" status: 200 len: 1271 microversion: 2.1 time: 0.095392 Jun 16 19:02:48.624527 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 219/462] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:48 2022] GET /compute/v2.1/servers/1e7cb911-e703-4b7d-98b6-18e49fe78d2e => generated 1271 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:02:48.666020 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-209f3f20-1426-41f5-90ff-a706879ac17f tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:48.675750 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-209f3f20-1426-41f5-90ff-a706879ac17f tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:48.677589 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-209f3f20-1426-41f5-90ff-a706879ac17f tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:48.678896 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-209f3f20-1426-41f5-90ff-a706879ac17f tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1808 microversion: 2.20 time: 0.431374 Jun 16 19:02:48.679487 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 244/463] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:48 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1808 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:02:48.979592 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-1d85534c-4a6b-401f-a388-755e2eef0306 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:48.980249 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-1d85534c-4a6b-401f-a388-755e2eef0306 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: b99da3e1-cab4-41a0-a1e4-6a29efeb77f2] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:48.986706 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-1d85534c-4a6b-401f-a388-755e2eef0306 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:48.987166 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-1d85534c-4a6b-401f-a388-755e2eef0306 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:48.987945 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-1d85534c-4a6b-401f-a388-755e2eef0306 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:48.988389 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-1d85534c-4a6b-401f-a388-755e2eef0306 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:49.153828 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-1d85534c-4a6b-401f-a388-755e2eef0306 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:49.161391 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-1d85534c-4a6b-401f-a388-755e2eef0306 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2" status: 200 len: 1266 microversion: 2.1 time: 0.186399 Jun 16 19:02:49.162029 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 220/464] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:48 2022] GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2 => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:49.641453 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-5dddd8a5-3d4a-4ae1-826d-70c2a89eeb48 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:49.642380 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-5dddd8a5-3d4a-4ae1-826d-70c2a89eeb48 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] [instance: 1e7cb911-e703-4b7d-98b6-18e49fe78d2e] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:49.649738 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-5dddd8a5-3d4a-4ae1-826d-70c2a89eeb48 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:49.650694 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-5dddd8a5-3d4a-4ae1-826d-70c2a89eeb48 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:49.652115 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-5dddd8a5-3d4a-4ae1-826d-70c2a89eeb48 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:49.652608 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-5dddd8a5-3d4a-4ae1-826d-70c2a89eeb48 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:49.701067 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-8709c41c-d145-4fe7-b818-c5c2b9c6fea4 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:49.702221 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-8709c41c-d145-4fe7-b818-c5c2b9c6fea4 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:49.708656 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:02:49.711113 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-8709c41c-d145-4fe7-b818-c5c2b9c6fea4 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:49.711744 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-8709c41c-d145-4fe7-b818-c5c2b9c6fea4 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:49.712727 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-8709c41c-d145-4fe7-b818-c5c2b9c6fea4 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:49.713410 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-8709c41c-d145-4fe7-b818-c5c2b9c6fea4 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:49.877274 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-8709c41c-d145-4fe7-b818-c5c2b9c6fea4 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:49.887489 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-8709c41c-d145-4fe7-b818-c5c2b9c6fea4 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:49.887653 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-5dddd8a5-3d4a-4ae1-826d-70c2a89eeb48 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb08a57a393d4c8591da42cd5e92aca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c879d7f44189ab76e377c33f5e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:49.889575 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-8709c41c-d145-4fe7-b818-c5c2b9c6fea4 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:49.891009 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-8709c41c-d145-4fe7-b818-c5c2b9c6fea4 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1808 microversion: 2.20 time: 0.194813 Jun 16 19:02:49.898262 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-5dddd8a5-3d4a-4ae1-826d-70c2a89eeb48 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] 10.222.0.70 "GET /compute/v2.1/servers/1e7cb911-e703-4b7d-98b6-18e49fe78d2e" status: 200 len: 1319 microversion: 2.1 time: 0.261150 Jun 16 19:02:49.901033 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 245/465] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:49 2022] GET /compute/v2.1/servers/1e7cb911-e703-4b7d-98b6-18e49fe78d2e => generated 1319 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:49.903802 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 221/466] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:49 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1808 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:02:50.179277 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-8562cf62-48fc-47e0-86cc-d3c51d5f64c6 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:50.179831 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-8562cf62-48fc-47e0-86cc-d3c51d5f64c6 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: b99da3e1-cab4-41a0-a1e4-6a29efeb77f2] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:50.187096 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-8562cf62-48fc-47e0-86cc-d3c51d5f64c6 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:50.187613 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-8562cf62-48fc-47e0-86cc-d3c51d5f64c6 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:50.188458 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-8562cf62-48fc-47e0-86cc-d3c51d5f64c6 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:50.188971 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-8562cf62-48fc-47e0-86cc-d3c51d5f64c6 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:50.395310 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-8562cf62-48fc-47e0-86cc-d3c51d5f64c6 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:50.409330 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-8562cf62-48fc-47e0-86cc-d3c51d5f64c6 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2" status: 200 len: 1266 microversion: 2.1 time: 0.233561 Jun 16 19:02:50.410998 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 246/467] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:50 2022] GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2 => generated 1266 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:50.607317 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [req-e9fa7d0f-72c3-40f2-a678-270c4a078257 req-2453d091-525e-4c5f-b05b-446cafb45d10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e7cb911-e703-4b7d-98b6-18e49fe78d2e", "tag": "96be2083-6edc-4da3-b172-f464c3715da2"}]} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:02:50.617069 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-e9fa7d0f-72c3-40f2-a678-270c4a078257 req-2453d091-525e-4c5f-b05b-446cafb45d10 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:50.617447 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-e9fa7d0f-72c3-40f2-a678-270c4a078257 req-2453d091-525e-4c5f-b05b-446cafb45d10 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:50.631350 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.compute.server_external_events [req-e9fa7d0f-72c3-40f2-a678-270c4a078257 req-2453d091-525e-4c5f-b05b-446cafb45d10 service nova] Creating event network-changed:96be2083-6edc-4da3-b172-f464c3715da2 for instance 1e7cb911-e703-4b7d-98b6-18e49fe78d2e on hv-cinder-84617 Jun 16 19:02:50.637231 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [req-e9fa7d0f-72c3-40f2-a678-270c4a078257 req-2453d091-525e-4c5f-b05b-446cafb45d10 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036294 Jun 16 19:02:50.637860 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 222/468] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:02:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:02:50.910483 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-120055fa-16d6-476f-9a58-56d8030aa749 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:50.911159 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-120055fa-16d6-476f-9a58-56d8030aa749 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:50.918562 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-07c07b85-a0a2-4f52-8a7d-217bf49c5e3c tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:50.919498 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-120055fa-16d6-476f-9a58-56d8030aa749 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:50.920126 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-120055fa-16d6-476f-9a58-56d8030aa749 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:50.920399 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-07c07b85-a0a2-4f52-8a7d-217bf49c5e3c tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] [instance: 1e7cb911-e703-4b7d-98b6-18e49fe78d2e] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:50.920897 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-120055fa-16d6-476f-9a58-56d8030aa749 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:50.921329 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-120055fa-16d6-476f-9a58-56d8030aa749 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:50.927902 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-07c07b85-a0a2-4f52-8a7d-217bf49c5e3c tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:50.928352 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-07c07b85-a0a2-4f52-8a7d-217bf49c5e3c tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:50.929118 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-07c07b85-a0a2-4f52-8a7d-217bf49c5e3c tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:50.929555 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-07c07b85-a0a2-4f52-8a7d-217bf49c5e3c tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:51.074731 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-07c07b85-a0a2-4f52-8a7d-217bf49c5e3c tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb08a57a393d4c8591da42cd5e92aca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c879d7f44189ab76e377c33f5e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:51.083070 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-07c07b85-a0a2-4f52-8a7d-217bf49c5e3c tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] 10.222.0.70 "GET /compute/v2.1/servers/1e7cb911-e703-4b7d-98b6-18e49fe78d2e" status: 200 len: 1319 microversion: 2.1 time: 0.169623 Jun 16 19:02:51.083935 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 223/469] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:50 2022] GET /compute/v2.1/servers/1e7cb911-e703-4b7d-98b6-18e49fe78d2e => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:02:51.142701 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-120055fa-16d6-476f-9a58-56d8030aa749 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:51.152242 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-120055fa-16d6-476f-9a58-56d8030aa749 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:51.153767 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-120055fa-16d6-476f-9a58-56d8030aa749 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:51.154941 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-120055fa-16d6-476f-9a58-56d8030aa749 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1808 microversion: 2.20 time: 0.248656 Jun 16 19:02:51.155489 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 247/470] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:50 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1808 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:02:51.386390 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [req-78cf753d-227c-432d-8077-4b12c32f3ebe req-498e9509-061b-4001-963b-9e3afd6a6773 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b99da3e1-cab4-41a0-a1e4-6a29efeb77f2", "name": "network-vif-plugged", "status": "completed", "tag": "3e69a90c-a36f-422b-a615-de50c8751ec1"}]} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:02:51.394860 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-78cf753d-227c-432d-8077-4b12c32f3ebe req-498e9509-061b-4001-963b-9e3afd6a6773 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:51.395303 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-78cf753d-227c-432d-8077-4b12c32f3ebe req-498e9509-061b-4001-963b-9e3afd6a6773 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:51.408340 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.compute.server_external_events [req-78cf753d-227c-432d-8077-4b12c32f3ebe req-498e9509-061b-4001-963b-9e3afd6a6773 service nova] Creating event network-vif-plugged:3e69a90c-a36f-422b-a615-de50c8751ec1 for instance b99da3e1-cab4-41a0-a1e4-6a29efeb77f2 on hv-cinder-84617 Jun 16 19:02:51.413054 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [req-78cf753d-227c-432d-8077-4b12c32f3ebe req-498e9509-061b-4001-963b-9e3afd6a6773 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031377 Jun 16 19:02:51.413651 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 224/471] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:02:51.428490 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-1b59a3dc-7ff4-4e83-8cda-fd017e4d74a9 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:51.429114 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-1b59a3dc-7ff4-4e83-8cda-fd017e4d74a9 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: b99da3e1-cab4-41a0-a1e4-6a29efeb77f2] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:51.440302 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-1b59a3dc-7ff4-4e83-8cda-fd017e4d74a9 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:51.440887 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-1b59a3dc-7ff4-4e83-8cda-fd017e4d74a9 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:51.441739 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-1b59a3dc-7ff4-4e83-8cda-fd017e4d74a9 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:51.442226 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-1b59a3dc-7ff4-4e83-8cda-fd017e4d74a9 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:51.590071 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-1b59a3dc-7ff4-4e83-8cda-fd017e4d74a9 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:51.597981 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-1b59a3dc-7ff4-4e83-8cda-fd017e4d74a9 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2" status: 200 len: 1266 microversion: 2.1 time: 0.173378 Jun 16 19:02:51.598540 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 248/472] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:51 2022] GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:52.101261 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-0caff190-bd09-4d02-8481-162ae61fae2f tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:52.101964 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-0caff190-bd09-4d02-8481-162ae61fae2f tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] [instance: 1e7cb911-e703-4b7d-98b6-18e49fe78d2e] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:52.104698 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_cell0:SELECT=2 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:02:52.105523 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_cell0:SELECT=8 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:02:52.112440 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0caff190-bd09-4d02-8481-162ae61fae2f tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:52.112892 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0caff190-bd09-4d02-8481-162ae61fae2f tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:52.113662 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0caff190-bd09-4d02-8481-162ae61fae2f tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:52.114109 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0caff190-bd09-4d02-8481-162ae61fae2f tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:52.173254 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-02e967ad-3d4a-4282-a2af-7be35867269b tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:52.174004 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-02e967ad-3d4a-4282-a2af-7be35867269b tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:52.182035 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-02e967ad-3d4a-4282-a2af-7be35867269b tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:52.182035 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-02e967ad-3d4a-4282-a2af-7be35867269b tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:52.183006 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-02e967ad-3d4a-4282-a2af-7be35867269b tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:52.183656 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-02e967ad-3d4a-4282-a2af-7be35867269b tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:52.250912 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-0caff190-bd09-4d02-8481-162ae61fae2f tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb08a57a393d4c8591da42cd5e92aca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c879d7f44189ab76e377c33f5e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:52.258698 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-0caff190-bd09-4d02-8481-162ae61fae2f tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] 10.222.0.70 "GET /compute/v2.1/servers/1e7cb911-e703-4b7d-98b6-18e49fe78d2e" status: 200 len: 1319 microversion: 2.1 time: 0.161574 Jun 16 19:02:52.259576 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 225/473] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:52 2022] GET /compute/v2.1/servers/1e7cb911-e703-4b7d-98b6-18e49fe78d2e => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:52.316791 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-02e967ad-3d4a-4282-a2af-7be35867269b tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:52.325411 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-02e967ad-3d4a-4282-a2af-7be35867269b tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:52.327016 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-02e967ad-3d4a-4282-a2af-7be35867269b tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:52.328216 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-02e967ad-3d4a-4282-a2af-7be35867269b tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1808 microversion: 2.20 time: 0.158871 Jun 16 19:02:52.328812 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 249/474] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:52 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:02:52.623442 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-9484d31c-1a21-472f-b6f6-3da1239bea22 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:52.624251 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-9484d31c-1a21-472f-b6f6-3da1239bea22 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: b99da3e1-cab4-41a0-a1e4-6a29efeb77f2] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:52.632089 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-9484d31c-1a21-472f-b6f6-3da1239bea22 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:52.632540 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-9484d31c-1a21-472f-b6f6-3da1239bea22 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:52.633374 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-9484d31c-1a21-472f-b6f6-3da1239bea22 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:52.635471 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-9484d31c-1a21-472f-b6f6-3da1239bea22 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:52.776856 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-9484d31c-1a21-472f-b6f6-3da1239bea22 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:52.784563 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-9484d31c-1a21-472f-b6f6-3da1239bea22 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2" status: 200 len: 1266 microversion: 2.1 time: 0.166132 Jun 16 19:02:52.785377 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 226/475] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:52 2022] GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:53.276114 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-d3539848-c8fe-455c-b553-8b0e21105e39 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:53.276827 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-d3539848-c8fe-455c-b553-8b0e21105e39 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] [instance: 1e7cb911-e703-4b7d-98b6-18e49fe78d2e] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:53.283353 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d3539848-c8fe-455c-b553-8b0e21105e39 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:53.283804 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d3539848-c8fe-455c-b553-8b0e21105e39 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:53.284574 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d3539848-c8fe-455c-b553-8b0e21105e39 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:53.285017 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d3539848-c8fe-455c-b553-8b0e21105e39 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:53.347666 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-31148da0-a533-4689-929b-127967b4eda2 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:53.348267 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-31148da0-a533-4689-929b-127967b4eda2 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:53.356017 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-31148da0-a533-4689-929b-127967b4eda2 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:53.356463 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-31148da0-a533-4689-929b-127967b4eda2 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:53.357229 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-31148da0-a533-4689-929b-127967b4eda2 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:53.357660 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-31148da0-a533-4689-929b-127967b4eda2 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:53.485208 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-d3539848-c8fe-455c-b553-8b0e21105e39 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb08a57a393d4c8591da42cd5e92aca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c879d7f44189ab76e377c33f5e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:53.492490 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-d3539848-c8fe-455c-b553-8b0e21105e39 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] 10.222.0.70 "GET /compute/v2.1/servers/1e7cb911-e703-4b7d-98b6-18e49fe78d2e" status: 200 len: 1319 microversion: 2.1 time: 0.220782 Jun 16 19:02:53.494289 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 250/476] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:53 2022] GET /compute/v2.1/servers/1e7cb911-e703-4b7d-98b6-18e49fe78d2e => generated 1319 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:53.500940 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-31148da0-a533-4689-929b-127967b4eda2 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:53.510902 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-31148da0-a533-4689-929b-127967b4eda2 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:53.512416 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-31148da0-a533-4689-929b-127967b4eda2 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:53.513580 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-31148da0-a533-4689-929b-127967b4eda2 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1808 microversion: 2.20 time: 0.169811 Jun 16 19:02:53.514139 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 227/477] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:53 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:02:53.802134 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-ec5c17e7-c7be-4d19-a1d1-2efd71937bb2 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:53.802769 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-ec5c17e7-c7be-4d19-a1d1-2efd71937bb2 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: b99da3e1-cab4-41a0-a1e4-6a29efeb77f2] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:53.809103 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ec5c17e7-c7be-4d19-a1d1-2efd71937bb2 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:53.809541 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ec5c17e7-c7be-4d19-a1d1-2efd71937bb2 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:53.810474 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ec5c17e7-c7be-4d19-a1d1-2efd71937bb2 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:53.811086 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ec5c17e7-c7be-4d19-a1d1-2efd71937bb2 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:53.954231 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-ec5c17e7-c7be-4d19-a1d1-2efd71937bb2 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:53.956573 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_cell1:SELECT=100 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:02:53.965453 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-ec5c17e7-c7be-4d19-a1d1-2efd71937bb2 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2" status: 200 len: 1266 microversion: 2.1 time: 0.167670 Jun 16 19:02:53.966074 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 251/478] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:53 2022] GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:54.509925 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-6c501083-11f4-4892-a8d3-435f6b625e7a tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:54.510764 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-6c501083-11f4-4892-a8d3-435f6b625e7a tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] [instance: 1e7cb911-e703-4b7d-98b6-18e49fe78d2e] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:54.517977 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-6c501083-11f4-4892-a8d3-435f6b625e7a tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:54.518437 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-6c501083-11f4-4892-a8d3-435f6b625e7a tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:54.519276 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-6c501083-11f4-4892-a8d3-435f6b625e7a tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:54.519718 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-6c501083-11f4-4892-a8d3-435f6b625e7a tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:54.532542 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-fe3c7e13-4f60-42fe-b811-c6e3f5e952ad tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:54.533517 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-fe3c7e13-4f60-42fe-b811-c6e3f5e952ad tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:54.540311 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-fe3c7e13-4f60-42fe-b811-c6e3f5e952ad tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:54.540876 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-fe3c7e13-4f60-42fe-b811-c6e3f5e952ad tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:54.541675 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-fe3c7e13-4f60-42fe-b811-c6e3f5e952ad tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:54.542129 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-fe3c7e13-4f60-42fe-b811-c6e3f5e952ad tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:54.672946 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-6c501083-11f4-4892-a8d3-435f6b625e7a tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb08a57a393d4c8591da42cd5e92aca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c879d7f44189ab76e377c33f5e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:54.681245 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-6c501083-11f4-4892-a8d3-435f6b625e7a tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] 10.222.0.70 "GET /compute/v2.1/servers/1e7cb911-e703-4b7d-98b6-18e49fe78d2e" status: 200 len: 1319 microversion: 2.1 time: 0.175763 Jun 16 19:02:54.681863 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 228/479] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:54 2022] GET /compute/v2.1/servers/1e7cb911-e703-4b7d-98b6-18e49fe78d2e => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:54.697107 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-fe3c7e13-4f60-42fe-b811-c6e3f5e952ad tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:54.705991 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-fe3c7e13-4f60-42fe-b811-c6e3f5e952ad tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:54.707564 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-fe3c7e13-4f60-42fe-b811-c6e3f5e952ad tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:54.708731 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-fe3c7e13-4f60-42fe-b811-c6e3f5e952ad tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1808 microversion: 2.20 time: 0.180409 Jun 16 19:02:54.709318 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 252/480] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:54 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1808 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:02:54.982790 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-532cb55d-cb08-47d5-a27a-4978a6ae200f tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:54.983455 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-532cb55d-cb08-47d5-a27a-4978a6ae200f tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: b99da3e1-cab4-41a0-a1e4-6a29efeb77f2] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:54.989637 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-532cb55d-cb08-47d5-a27a-4978a6ae200f tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:54.990080 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-532cb55d-cb08-47d5-a27a-4978a6ae200f tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:54.990870 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-532cb55d-cb08-47d5-a27a-4978a6ae200f tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:54.991300 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-532cb55d-cb08-47d5-a27a-4978a6ae200f tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:55.121760 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-532cb55d-cb08-47d5-a27a-4978a6ae200f tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:55.129533 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-532cb55d-cb08-47d5-a27a-4978a6ae200f tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2" status: 200 len: 1266 microversion: 2.1 time: 0.150657 Jun 16 19:02:55.130116 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 229/481] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:54 2022] GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:55.698916 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-0810c066-c002-4509-b032-58311fa9d3be tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:55.699774 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-0810c066-c002-4509-b032-58311fa9d3be tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] [instance: 1e7cb911-e703-4b7d-98b6-18e49fe78d2e] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:55.706110 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-0810c066-c002-4509-b032-58311fa9d3be tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:55.706562 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-0810c066-c002-4509-b032-58311fa9d3be tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:55.707389 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-0810c066-c002-4509-b032-58311fa9d3be tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:55.707840 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-0810c066-c002-4509-b032-58311fa9d3be tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:55.727427 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-6d50e849-f923-4432-aed7-743eafd9f491 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:55.728223 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-6d50e849-f923-4432-aed7-743eafd9f491 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:55.735178 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-6d50e849-f923-4432-aed7-743eafd9f491 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:55.735656 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-6d50e849-f923-4432-aed7-743eafd9f491 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:55.736477 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-6d50e849-f923-4432-aed7-743eafd9f491 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:55.736954 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-6d50e849-f923-4432-aed7-743eafd9f491 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:55.859599 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-0810c066-c002-4509-b032-58311fa9d3be tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb08a57a393d4c8591da42cd5e92aca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c879d7f44189ab76e377c33f5e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:55.868299 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-0810c066-c002-4509-b032-58311fa9d3be tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] 10.222.0.70 "GET /compute/v2.1/servers/1e7cb911-e703-4b7d-98b6-18e49fe78d2e" status: 200 len: 1319 microversion: 2.1 time: 0.173506 Jun 16 19:02:55.869278 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 253/482] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:55 2022] GET /compute/v2.1/servers/1e7cb911-e703-4b7d-98b6-18e49fe78d2e => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:55.876842 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-6d50e849-f923-4432-aed7-743eafd9f491 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:55.887157 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-6d50e849-f923-4432-aed7-743eafd9f491 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:55.888655 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-6d50e849-f923-4432-aed7-743eafd9f491 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:55.889827 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-6d50e849-f923-4432-aed7-743eafd9f491 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1808 microversion: 2.20 time: 0.166530 Jun 16 19:02:55.890390 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 230/483] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:55 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:02:56.146340 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-690f47af-4eb5-4d72-ad87-8aec33929ba8 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:56.146990 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-690f47af-4eb5-4d72-ad87-8aec33929ba8 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: b99da3e1-cab4-41a0-a1e4-6a29efeb77f2] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:56.154638 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-690f47af-4eb5-4d72-ad87-8aec33929ba8 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:56.155090 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-690f47af-4eb5-4d72-ad87-8aec33929ba8 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:56.155849 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-690f47af-4eb5-4d72-ad87-8aec33929ba8 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:56.156281 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-690f47af-4eb5-4d72-ad87-8aec33929ba8 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:56.307690 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-690f47af-4eb5-4d72-ad87-8aec33929ba8 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:56.315582 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-690f47af-4eb5-4d72-ad87-8aec33929ba8 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2" status: 200 len: 1266 microversion: 2.1 time: 0.173057 Jun 16 19:02:56.316160 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 254/484] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:56 2022] GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:56.885730 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-849e1783-6b96-4ed1-9cb6-a4efa143949f tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:56.886324 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-849e1783-6b96-4ed1-9cb6-a4efa143949f tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] [instance: 1e7cb911-e703-4b7d-98b6-18e49fe78d2e] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:56.893165 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-849e1783-6b96-4ed1-9cb6-a4efa143949f tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:56.893615 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-849e1783-6b96-4ed1-9cb6-a4efa143949f tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:56.894471 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-849e1783-6b96-4ed1-9cb6-a4efa143949f tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:56.895018 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-849e1783-6b96-4ed1-9cb6-a4efa143949f tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:56.908439 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-3ce67bb0-6609-4913-ba80-58db705f9974 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:56.909058 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-3ce67bb0-6609-4913-ba80-58db705f9974 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:56.916731 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-3ce67bb0-6609-4913-ba80-58db705f9974 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:56.917188 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-3ce67bb0-6609-4913-ba80-58db705f9974 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:56.917958 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-3ce67bb0-6609-4913-ba80-58db705f9974 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:56.918392 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-3ce67bb0-6609-4913-ba80-58db705f9974 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:57.031795 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-849e1783-6b96-4ed1-9cb6-a4efa143949f tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb08a57a393d4c8591da42cd5e92aca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c879d7f44189ab76e377c33f5e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:57.039168 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-849e1783-6b96-4ed1-9cb6-a4efa143949f tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] 10.222.0.70 "GET /compute/v2.1/servers/1e7cb911-e703-4b7d-98b6-18e49fe78d2e" status: 200 len: 1319 microversion: 2.1 time: 0.157462 Jun 16 19:02:57.040259 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 231/485] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:56 2022] GET /compute/v2.1/servers/1e7cb911-e703-4b7d-98b6-18e49fe78d2e => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:57.051969 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-3ce67bb0-6609-4913-ba80-58db705f9974 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:57.061194 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-3ce67bb0-6609-4913-ba80-58db705f9974 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:57.062837 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-3ce67bb0-6609-4913-ba80-58db705f9974 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:57.064048 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-3ce67bb0-6609-4913-ba80-58db705f9974 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1808 microversion: 2.20 time: 0.159516 Jun 16 19:02:57.064601 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 255/486] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:56 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:02:57.333432 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-77ccd351-bfe0-4452-8678-43b13853a0ae tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:57.334002 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-77ccd351-bfe0-4452-8678-43b13853a0ae tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: b99da3e1-cab4-41a0-a1e4-6a29efeb77f2] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:57.340854 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-77ccd351-bfe0-4452-8678-43b13853a0ae tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:57.341305 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-77ccd351-bfe0-4452-8678-43b13853a0ae tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:57.342074 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-77ccd351-bfe0-4452-8678-43b13853a0ae tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:57.342508 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-77ccd351-bfe0-4452-8678-43b13853a0ae tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:57.479993 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-77ccd351-bfe0-4452-8678-43b13853a0ae tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:57.488473 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-77ccd351-bfe0-4452-8678-43b13853a0ae tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2" status: 200 len: 1454 microversion: 2.1 time: 0.158998 Jun 16 19:02:57.489050 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 232/487] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:57 2022] GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2 => generated 1454 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:57.505938 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-c6d4af19-0b5a-49f6-a307-a16d452ea202 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:57.506588 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-c6d4af19-0b5a-49f6-a307-a16d452ea202 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: b99da3e1-cab4-41a0-a1e4-6a29efeb77f2] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:57.513524 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-c6d4af19-0b5a-49f6-a307-a16d452ea202 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:57.513973 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-c6d4af19-0b5a-49f6-a307-a16d452ea202 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:57.514757 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-c6d4af19-0b5a-49f6-a307-a16d452ea202 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:57.515185 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-c6d4af19-0b5a-49f6-a307-a16d452ea202 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:57.583387 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [req-1cbb52a4-5982-4ed5-805f-69b3e45433e5 req-35c3c7d4-a789-4d13-bbaf-edda2a698b90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e7cb911-e703-4b7d-98b6-18e49fe78d2e", "name": "network-vif-plugged", "status": "completed", "tag": "96be2083-6edc-4da3-b172-f464c3715da2"}]} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:02:57.594681 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-1cbb52a4-5982-4ed5-805f-69b3e45433e5 req-35c3c7d4-a789-4d13-bbaf-edda2a698b90 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:57.595227 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-1cbb52a4-5982-4ed5-805f-69b3e45433e5 req-35c3c7d4-a789-4d13-bbaf-edda2a698b90 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:57.610790 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.compute.server_external_events [req-1cbb52a4-5982-4ed5-805f-69b3e45433e5 req-35c3c7d4-a789-4d13-bbaf-edda2a698b90 service nova] Creating event network-vif-plugged:96be2083-6edc-4da3-b172-f464c3715da2 for instance 1e7cb911-e703-4b7d-98b6-18e49fe78d2e on hv-cinder-84617 Jun 16 19:02:57.616367 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [req-1cbb52a4-5982-4ed5-805f-69b3e45433e5 req-35c3c7d4-a789-4d13-bbaf-edda2a698b90 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036864 Jun 16 19:02:57.617483 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 233/488] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:02:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:02:57.661102 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-c6d4af19-0b5a-49f6-a307-a16d452ea202 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:57.669194 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-c6d4af19-0b5a-49f6-a307-a16d452ea202 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2" status: 200 len: 1454 microversion: 2.1 time: 0.167096 Jun 16 19:02:57.669756 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 256/489] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:57 2022] GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2 => generated 1454 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:58.058449 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-4d68a070-ad50-4c8d-b8f1-029f986a0678 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:58.059185 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-4d68a070-ad50-4c8d-b8f1-029f986a0678 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] [instance: 1e7cb911-e703-4b7d-98b6-18e49fe78d2e] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:58.065498 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-4d68a070-ad50-4c8d-b8f1-029f986a0678 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:58.065893 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-4d68a070-ad50-4c8d-b8f1-029f986a0678 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:58.066674 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-4d68a070-ad50-4c8d-b8f1-029f986a0678 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:58.067119 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-4d68a070-ad50-4c8d-b8f1-029f986a0678 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:58.083805 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-938f39d6-4042-4732-b5af-aaeff28b8d39 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:58.084445 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-938f39d6-4042-4732-b5af-aaeff28b8d39 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:58.093597 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-938f39d6-4042-4732-b5af-aaeff28b8d39 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:58.094362 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-938f39d6-4042-4732-b5af-aaeff28b8d39 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:58.096035 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-938f39d6-4042-4732-b5af-aaeff28b8d39 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:58.096645 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-938f39d6-4042-4732-b5af-aaeff28b8d39 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:58.238983 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-4d68a070-ad50-4c8d-b8f1-029f986a0678 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb08a57a393d4c8591da42cd5e92aca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c879d7f44189ab76e377c33f5e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:58.247648 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-4d68a070-ad50-4c8d-b8f1-029f986a0678 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] 10.222.0.70 "GET /compute/v2.1/servers/1e7cb911-e703-4b7d-98b6-18e49fe78d2e" status: 200 len: 1319 microversion: 2.1 time: 0.194448 Jun 16 19:02:58.248226 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 234/490] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:58 2022] GET /compute/v2.1/servers/1e7cb911-e703-4b7d-98b6-18e49fe78d2e => generated 1319 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:58.316635 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-938f39d6-4042-4732-b5af-aaeff28b8d39 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:58.326366 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-938f39d6-4042-4732-b5af-aaeff28b8d39 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:58.328075 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-938f39d6-4042-4732-b5af-aaeff28b8d39 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:58.329293 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-938f39d6-4042-4732-b5af-aaeff28b8d39 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1808 microversion: 2.20 time: 0.251158 Jun 16 19:02:58.329903 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 257/491] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:58 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1808 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:02:59.265730 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-3210b930-1d3c-449a-ae9f-400377dadd76 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:59.266339 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-3210b930-1d3c-449a-ae9f-400377dadd76 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] [instance: 1e7cb911-e703-4b7d-98b6-18e49fe78d2e] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:59.273749 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-3210b930-1d3c-449a-ae9f-400377dadd76 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:59.274808 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-3210b930-1d3c-449a-ae9f-400377dadd76 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:59.275874 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-3210b930-1d3c-449a-ae9f-400377dadd76 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:59.276316 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-3210b930-1d3c-449a-ae9f-400377dadd76 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:59.350905 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-a065875e-9f60-4284-bf56-ac12c9322365 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:02:59.352781 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-a065875e-9f60-4284-bf56-ac12c9322365 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:02:59.359954 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-a065875e-9f60-4284-bf56-ac12c9322365 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:59.360757 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-a065875e-9f60-4284-bf56-ac12c9322365 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:59.361632 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-a065875e-9f60-4284-bf56-ac12c9322365 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:59.362235 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-a065875e-9f60-4284-bf56-ac12c9322365 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:59.422166 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-3210b930-1d3c-449a-ae9f-400377dadd76 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb08a57a393d4c8591da42cd5e92aca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c879d7f44189ab76e377c33f5e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:59.425318 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_cell1:SELECT=100 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:02:59.433019 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-3210b930-1d3c-449a-ae9f-400377dadd76 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] 10.222.0.70 "GET /compute/v2.1/servers/1e7cb911-e703-4b7d-98b6-18e49fe78d2e" status: 200 len: 1319 microversion: 2.1 time: 0.171705 Jun 16 19:02:59.441615 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 235/492] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:02:59 2022] GET /compute/v2.1/servers/1e7cb911-e703-4b7d-98b6-18e49fe78d2e => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:02:59.602054 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-a065875e-9f60-4284-bf56-ac12c9322365 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:59.613237 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-a065875e-9f60-4284-bf56-ac12c9322365 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:59.615147 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-a065875e-9f60-4284-bf56-ac12c9322365 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:02:59.616367 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-a065875e-9f60-4284-bf56-ac12c9322365 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1808 microversion: 2.20 time: 0.271522 Jun 16 19:02:59.616928 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 258/493] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:02:59 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1808 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:02:59.732767 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [req-66402621-7786-4dea-b3d3-a8bbf2b11c64 req-0e29e53d-28ac-4f61-883f-b1d37e20790f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c077a29-12e0-48af-a8b6-43d0b5a79bf4", "name": "network-vif-plugged", "status": "completed", "tag": "3e9e841e-467e-4321-a3d7-1999929bc359"}]} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:02:59.740893 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-66402621-7786-4dea-b3d3-a8bbf2b11c64 req-0e29e53d-28ac-4f61-883f-b1d37e20790f service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:59.741342 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-66402621-7786-4dea-b3d3-a8bbf2b11c64 req-0e29e53d-28ac-4f61-883f-b1d37e20790f service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:59.754228 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.compute.server_external_events [req-66402621-7786-4dea-b3d3-a8bbf2b11c64 req-0e29e53d-28ac-4f61-883f-b1d37e20790f service nova] Creating event network-vif-plugged:3e9e841e-467e-4321-a3d7-1999929bc359 for instance 1c077a29-12e0-48af-a8b6-43d0b5a79bf4 on hv-cinder-84617 Jun 16 19:02:59.766318 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [req-66402621-7786-4dea-b3d3-a8bbf2b11c64 req-0e29e53d-28ac-4f61-883f-b1d37e20790f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038548 Jun 16 19:02:59.766962 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 236/494] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:02:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:02:59.902210 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [req-8f6bfd1c-f189-4697-a481-2aec83ccd175 req-833f0ac1-8442-4836-b1dc-4c29dc42d1c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b99da3e1-cab4-41a0-a1e4-6a29efeb77f2", "tag": "3e69a90c-a36f-422b-a615-de50c8751ec1"}]} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:02:59.910854 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-8f6bfd1c-f189-4697-a481-2aec83ccd175 req-833f0ac1-8442-4836-b1dc-4c29dc42d1c0 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:02:59.911304 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-8f6bfd1c-f189-4697-a481-2aec83ccd175 req-833f0ac1-8442-4836-b1dc-4c29dc42d1c0 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:02:59.923608 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.compute.server_external_events [req-8f6bfd1c-f189-4697-a481-2aec83ccd175 req-833f0ac1-8442-4836-b1dc-4c29dc42d1c0 service nova] Creating event network-changed:3e69a90c-a36f-422b-a615-de50c8751ec1 for instance b99da3e1-cab4-41a0-a1e4-6a29efeb77f2 on hv-cinder-84617 Jun 16 19:02:59.928680 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [req-8f6bfd1c-f189-4697-a481-2aec83ccd175 req-833f0ac1-8442-4836-b1dc-4c29dc42d1c0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030627 Jun 16 19:02:59.929285 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 259/495] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:02:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:03:00.451053 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-bd710cd0-79ee-4f2a-ab93-55e54d9159ec tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:00.451790 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-bd710cd0-79ee-4f2a-ab93-55e54d9159ec tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] [instance: 1e7cb911-e703-4b7d-98b6-18e49fe78d2e] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:00.459173 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-bd710cd0-79ee-4f2a-ab93-55e54d9159ec tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:00.459653 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-bd710cd0-79ee-4f2a-ab93-55e54d9159ec tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:00.460452 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-bd710cd0-79ee-4f2a-ab93-55e54d9159ec tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:00.460890 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-bd710cd0-79ee-4f2a-ab93-55e54d9159ec tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:00.604041 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-bd710cd0-79ee-4f2a-ab93-55e54d9159ec tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb08a57a393d4c8591da42cd5e92aca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c879d7f44189ab76e377c33f5e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:00.612259 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-bd710cd0-79ee-4f2a-ab93-55e54d9159ec tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] 10.222.0.70 "GET /compute/v2.1/servers/1e7cb911-e703-4b7d-98b6-18e49fe78d2e" status: 200 len: 1508 microversion: 2.1 time: 0.165982 Jun 16 19:03:00.612925 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 237/496] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:00 2022] GET /compute/v2.1/servers/1e7cb911-e703-4b7d-98b6-18e49fe78d2e => generated 1508 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:00.637322 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-3324e449-193b-41c2-90e4-3eb89531906c tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:00.638093 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-3324e449-193b-41c2-90e4-3eb89531906c tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:00.644998 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-3324e449-193b-41c2-90e4-3eb89531906c tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:00.645546 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-3324e449-193b-41c2-90e4-3eb89531906c tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:00.646443 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-3324e449-193b-41c2-90e4-3eb89531906c tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:00.646970 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-3324e449-193b-41c2-90e4-3eb89531906c tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:00.797944 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-3324e449-193b-41c2-90e4-3eb89531906c tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:00.814668 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-3324e449-193b-41c2-90e4-3eb89531906c tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:00.814668 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-3324e449-193b-41c2-90e4-3eb89531906c tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:00.814668 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-3324e449-193b-41c2-90e4-3eb89531906c tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1808 microversion: 2.20 time: 0.178030 Jun 16 19:03:00.815061 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 260/497] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:03:00 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:03:01.832205 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-6e653e68-ac8c-49a6-9366-43ea59dc5ffb tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:01.832811 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-6e653e68-ac8c-49a6-9366-43ea59dc5ffb tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:01.840021 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-6e653e68-ac8c-49a6-9366-43ea59dc5ffb tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:01.840470 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-6e653e68-ac8c-49a6-9366-43ea59dc5ffb tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:01.841214 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-6e653e68-ac8c-49a6-9366-43ea59dc5ffb tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:01.841645 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-6e653e68-ac8c-49a6-9366-43ea59dc5ffb tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:01.980882 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-6e653e68-ac8c-49a6-9366-43ea59dc5ffb tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:01.989368 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-6e653e68-ac8c-49a6-9366-43ea59dc5ffb tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:01.990893 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-6e653e68-ac8c-49a6-9366-43ea59dc5ffb tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:01.992030 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-6e653e68-ac8c-49a6-9366-43ea59dc5ffb tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1808 microversion: 2.20 time: 0.163782 Jun 16 19:03:01.992690 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 238/498] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:03:01 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:03:03.011812 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-0b1914b7-29fb-41b8-8bc8-94f403713dde tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:03.012434 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-0b1914b7-29fb-41b8-8bc8-94f403713dde tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:03.019010 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-0b1914b7-29fb-41b8-8bc8-94f403713dde tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:03.019492 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-0b1914b7-29fb-41b8-8bc8-94f403713dde tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:03.020261 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-0b1914b7-29fb-41b8-8bc8-94f403713dde tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:03.020697 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-0b1914b7-29fb-41b8-8bc8-94f403713dde tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:03.158345 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-0b1914b7-29fb-41b8-8bc8-94f403713dde tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:03.168148 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-0b1914b7-29fb-41b8-8bc8-94f403713dde tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:03.169699 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-0b1914b7-29fb-41b8-8bc8-94f403713dde tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:03.170887 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-0b1914b7-29fb-41b8-8bc8-94f403713dde tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1808 microversion: 2.20 time: 0.164191 Jun 16 19:03:03.171442 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 261/499] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:03:03 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:03:04.191349 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-09a4f2a1-e65f-48aa-b45a-8d08a5bb4b30 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:04.191956 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-09a4f2a1-e65f-48aa-b45a-8d08a5bb4b30 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:04.199818 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-09a4f2a1-e65f-48aa-b45a-8d08a5bb4b30 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:04.200285 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-09a4f2a1-e65f-48aa-b45a-8d08a5bb4b30 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:04.201180 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-09a4f2a1-e65f-48aa-b45a-8d08a5bb4b30 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:04.201593 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-09a4f2a1-e65f-48aa-b45a-8d08a5bb4b30 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:04.335215 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-09a4f2a1-e65f-48aa-b45a-8d08a5bb4b30 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:04.344432 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-09a4f2a1-e65f-48aa-b45a-8d08a5bb4b30 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:04.345975 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-09a4f2a1-e65f-48aa-b45a-8d08a5bb4b30 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:04.347194 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-09a4f2a1-e65f-48aa-b45a-8d08a5bb4b30 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1808 microversion: 2.20 time: 0.159729 Jun 16 19:03:04.347776 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 239/500] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:03:04 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:03:05.365805 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-17c07fe9-1030-4df3-a8a4-e13dee8e6eed tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:05.366454 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-17c07fe9-1030-4df3-a8a4-e13dee8e6eed tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:05.373292 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-17c07fe9-1030-4df3-a8a4-e13dee8e6eed tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:05.373753 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-17c07fe9-1030-4df3-a8a4-e13dee8e6eed tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:05.374523 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-17c07fe9-1030-4df3-a8a4-e13dee8e6eed tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:05.375067 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-17c07fe9-1030-4df3-a8a4-e13dee8e6eed tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:05.528363 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-17c07fe9-1030-4df3-a8a4-e13dee8e6eed tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:05.536769 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-17c07fe9-1030-4df3-a8a4-e13dee8e6eed tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:05.538396 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-17c07fe9-1030-4df3-a8a4-e13dee8e6eed tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:05.539582 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-17c07fe9-1030-4df3-a8a4-e13dee8e6eed tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1808 microversion: 2.20 time: 0.177820 Jun 16 19:03:05.541233 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 262/501] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:03:05 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1808 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:03:06.560437 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-97f7b4fb-3370-4d86-9318-ff0ad44ee51c tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:06.561050 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-97f7b4fb-3370-4d86-9318-ff0ad44ee51c tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:06.567590 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-97f7b4fb-3370-4d86-9318-ff0ad44ee51c tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:06.568041 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-97f7b4fb-3370-4d86-9318-ff0ad44ee51c tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:06.568798 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-97f7b4fb-3370-4d86-9318-ff0ad44ee51c tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:06.569232 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-97f7b4fb-3370-4d86-9318-ff0ad44ee51c tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:06.706991 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-97f7b4fb-3370-4d86-9318-ff0ad44ee51c tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:06.715699 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-97f7b4fb-3370-4d86-9318-ff0ad44ee51c tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:06.717117 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-97f7b4fb-3370-4d86-9318-ff0ad44ee51c tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:06.718265 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-97f7b4fb-3370-4d86-9318-ff0ad44ee51c tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1795 microversion: 2.20 time: 0.161902 Jun 16 19:03:06.718850 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 240/502] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:03:06 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1795 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:03:19.984222 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-b04b483a-9ae7-4c4e-bc24-8c3031b7c7ff tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:03:19.985205 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-b04b483a-9ae7-4c4e-bc24-8c3031b7c7ff tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] [instance: edce90bf-b3d6-49de-a45f-9b65e1759b51] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:19.987593 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_api:SELECT=41 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:03:19.988427 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_cell1:SELECT=63 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:03:19.995956 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-b04b483a-9ae7-4c4e-bc24-8c3031b7c7ff tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:19.996471 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-b04b483a-9ae7-4c4e-bc24-8c3031b7c7ff tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:19.997330 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-b04b483a-9ae7-4c4e-bc24-8c3031b7c7ff tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:19.997768 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-b04b483a-9ae7-4c4e-bc24-8c3031b7c7ff tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:20.071029 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-b04b483a-9ae7-4c4e-bc24-8c3031b7c7ff tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] 10.222.0.70 "POST /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51/action" status: 202 len: 0 microversion: 2.1 time: 0.090475 Jun 16 19:03:20.071653 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 263/503] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Jun 16 19:03:19 2022] POST /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:03:20.080179 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-b5d5692b-8545-442c-a3b4-748ab7305101 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:20.081129 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-b5d5692b-8545-442c-a3b4-748ab7305101 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] [instance: edce90bf-b3d6-49de-a45f-9b65e1759b51] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:20.083443 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_api:SELECT=39 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:03:20.084102 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_cell1:SELECT=27 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:03:20.090744 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b5d5692b-8545-442c-a3b4-748ab7305101 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:20.091204 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b5d5692b-8545-442c-a3b4-748ab7305101 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:20.091976 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b5d5692b-8545-442c-a3b4-748ab7305101 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:20.092422 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b5d5692b-8545-442c-a3b4-748ab7305101 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:20.248744 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-b5d5692b-8545-442c-a3b4-748ab7305101 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047e841cefdd4975947b2c154412953b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741ee13164894b49be1a0fc6c1385a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:20.257387 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-b5d5692b-8545-442c-a3b4-748ab7305101 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] 10.222.0.70 "GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51" status: 200 len: 1753 microversion: 2.1 time: 0.181410 Jun 16 19:03:20.257959 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 241/504] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:20 2022] GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51 => generated 1753 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:20.850636 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-93d1d2c8-6f92-4ce1-b608-17063d19e27d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1c861886-2c72-4497-bec7-d33635c67c25"}} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:03:20.852766 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-93d1d2c8-6f92-4ce1-b608-17063d19e27d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:20.858972 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-93d1d2c8-6f92-4ce1-b608-17063d19e27d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:20.859431 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-93d1d2c8-6f92-4ce1-b608-17063d19e27d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:20.860205 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-93d1d2c8-6f92-4ce1-b608-17063d19e27d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:20.860651 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-93d1d2c8-6f92-4ce1-b608-17063d19e27d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:21.281062 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-d3e7000d-12c4-4e9a-9575-b88ce913a002 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:21.281888 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-d3e7000d-12c4-4e9a-9575-b88ce913a002 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] [instance: edce90bf-b3d6-49de-a45f-9b65e1759b51] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:21.290191 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d3e7000d-12c4-4e9a-9575-b88ce913a002 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:21.291318 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d3e7000d-12c4-4e9a-9575-b88ce913a002 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:21.292101 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d3e7000d-12c4-4e9a-9575-b88ce913a002 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:21.292544 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d3e7000d-12c4-4e9a-9575-b88ce913a002 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:21.292669 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-93d1d2c8-6f92-4ce1-b608-17063d19e27d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "POST /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.446271 Jun 16 19:03:21.293346 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 264/505] 10.222.0.70 () {60 vars in 1322 bytes} [Thu Jun 16 19:03:20 2022] POST /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f/os-volume_attachments => generated 194 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:03:21.299550 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-855fd00b-93ce-4018-86c1-07a13302bdd0 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "de4d7601-4f85-4e1b-9ddc-e01fd21d6903", "device": "/dev/sdb"}} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:03:21.301276 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-855fd00b-93ce-4018-86c1-07a13302bdd0 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] [instance: 1e7cb911-e703-4b7d-98b6-18e49fe78d2e] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:21.308862 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-855fd00b-93ce-4018-86c1-07a13302bdd0 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:21.309478 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-855fd00b-93ce-4018-86c1-07a13302bdd0 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:21.310262 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-855fd00b-93ce-4018-86c1-07a13302bdd0 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:21.310991 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-855fd00b-93ce-4018-86c1-07a13302bdd0 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:21.459893 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-d3e7000d-12c4-4e9a-9575-b88ce913a002 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047e841cefdd4975947b2c154412953b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741ee13164894b49be1a0fc6c1385a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:21.468311 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-d3e7000d-12c4-4e9a-9575-b88ce913a002 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] 10.222.0.70 "GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51" status: 200 len: 1758 microversion: 2.1 time: 0.196426 Jun 16 19:03:21.478873 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 242/506] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:21 2022] GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51 => generated 1758 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:21.585151 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-855fd00b-93ce-4018-86c1-07a13302bdd0 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] 10.222.0.70 "POST /compute/v2.1/servers/1e7cb911-e703-4b7d-98b6-18e49fe78d2e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.290455 Jun 16 19:03:21.585925 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 265/507] 10.222.0.70 () {60 vars in 1322 bytes} [Thu Jun 16 19:03:21 2022] POST /compute/v2.1/servers/1e7cb911-e703-4b7d-98b6-18e49fe78d2e/os-volume_attachments => generated 194 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:03:22.486092 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-8256d9e8-629b-489c-b801-55682fd7b7b4 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:22.486728 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-8256d9e8-629b-489c-b801-55682fd7b7b4 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] [instance: edce90bf-b3d6-49de-a45f-9b65e1759b51] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:22.493618 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-8256d9e8-629b-489c-b801-55682fd7b7b4 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:22.494068 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-8256d9e8-629b-489c-b801-55682fd7b7b4 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:22.494886 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-8256d9e8-629b-489c-b801-55682fd7b7b4 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:22.495311 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-8256d9e8-629b-489c-b801-55682fd7b7b4 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:22.636017 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-8256d9e8-629b-489c-b801-55682fd7b7b4 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047e841cefdd4975947b2c154412953b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741ee13164894b49be1a0fc6c1385a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:22.644041 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-8256d9e8-629b-489c-b801-55682fd7b7b4 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] 10.222.0.70 "GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51" status: 200 len: 1758 microversion: 2.1 time: 0.161827 Jun 16 19:03:22.644626 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 243/508] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:22 2022] GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51 => generated 1758 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:23.664702 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-a38a3529-60c3-4f8d-a7dc-209a9c0c4970 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:23.666081 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-a38a3529-60c3-4f8d-a7dc-209a9c0c4970 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] [instance: edce90bf-b3d6-49de-a45f-9b65e1759b51] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:23.672756 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-a38a3529-60c3-4f8d-a7dc-209a9c0c4970 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:23.673204 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-a38a3529-60c3-4f8d-a7dc-209a9c0c4970 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:23.673970 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-a38a3529-60c3-4f8d-a7dc-209a9c0c4970 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:23.674440 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-a38a3529-60c3-4f8d-a7dc-209a9c0c4970 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:23.820625 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-a38a3529-60c3-4f8d-a7dc-209a9c0c4970 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047e841cefdd4975947b2c154412953b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741ee13164894b49be1a0fc6c1385a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:23.828468 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-a38a3529-60c3-4f8d-a7dc-209a9c0c4970 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] 10.222.0.70 "GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51" status: 200 len: 1758 microversion: 2.1 time: 0.169314 Jun 16 19:03:23.829029 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 266/509] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:23 2022] GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51 => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:24.845200 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-3e63ef4b-2a6c-4d4c-9032-0ce6ca6deddd tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:24.845831 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-3e63ef4b-2a6c-4d4c-9032-0ce6ca6deddd tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] [instance: edce90bf-b3d6-49de-a45f-9b65e1759b51] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:24.852852 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-3e63ef4b-2a6c-4d4c-9032-0ce6ca6deddd tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:24.853296 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-3e63ef4b-2a6c-4d4c-9032-0ce6ca6deddd tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:24.854055 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-3e63ef4b-2a6c-4d4c-9032-0ce6ca6deddd tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:24.854492 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-3e63ef4b-2a6c-4d4c-9032-0ce6ca6deddd tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:24.997694 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-3e63ef4b-2a6c-4d4c-9032-0ce6ca6deddd tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047e841cefdd4975947b2c154412953b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741ee13164894b49be1a0fc6c1385a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:25.005617 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-3e63ef4b-2a6c-4d4c-9032-0ce6ca6deddd tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] 10.222.0.70 "GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51" status: 200 len: 1758 microversion: 2.1 time: 0.164378 Jun 16 19:03:25.006194 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 244/510] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:24 2022] GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51 => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:26.023612 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-d82d01f8-a8b9-4bb9-848a-89de342a108c tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:26.024247 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-d82d01f8-a8b9-4bb9-848a-89de342a108c tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] [instance: edce90bf-b3d6-49de-a45f-9b65e1759b51] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:26.031023 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d82d01f8-a8b9-4bb9-848a-89de342a108c tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:26.031473 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d82d01f8-a8b9-4bb9-848a-89de342a108c tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:26.032253 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d82d01f8-a8b9-4bb9-848a-89de342a108c tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:26.032702 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d82d01f8-a8b9-4bb9-848a-89de342a108c tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:26.180796 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-d82d01f8-a8b9-4bb9-848a-89de342a108c tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047e841cefdd4975947b2c154412953b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741ee13164894b49be1a0fc6c1385a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:26.188769 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-d82d01f8-a8b9-4bb9-848a-89de342a108c tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] 10.222.0.70 "GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51" status: 200 len: 1758 microversion: 2.1 time: 0.169502 Jun 16 19:03:26.189338 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 267/511] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:26 2022] GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51 => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:27.206485 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-3442fc62-eacd-44f9-a145-7bb1270a2778 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:27.207124 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-3442fc62-eacd-44f9-a145-7bb1270a2778 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] [instance: edce90bf-b3d6-49de-a45f-9b65e1759b51] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:27.214729 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-3442fc62-eacd-44f9-a145-7bb1270a2778 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:27.215176 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-3442fc62-eacd-44f9-a145-7bb1270a2778 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:27.215927 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-3442fc62-eacd-44f9-a145-7bb1270a2778 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:27.216355 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-3442fc62-eacd-44f9-a145-7bb1270a2778 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:27.366043 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-3442fc62-eacd-44f9-a145-7bb1270a2778 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047e841cefdd4975947b2c154412953b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741ee13164894b49be1a0fc6c1385a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:27.375217 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-3442fc62-eacd-44f9-a145-7bb1270a2778 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] 10.222.0.70 "GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51" status: 200 len: 1758 microversion: 2.1 time: 0.172673 Jun 16 19:03:27.375780 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 245/512] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:27 2022] GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51 => generated 1758 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:28.393124 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-57b84485-413e-4dca-9689-434bb639f568 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:28.393724 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-57b84485-413e-4dca-9689-434bb639f568 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] [instance: edce90bf-b3d6-49de-a45f-9b65e1759b51] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:28.401125 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-57b84485-413e-4dca-9689-434bb639f568 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:28.401568 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-57b84485-413e-4dca-9689-434bb639f568 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:28.402335 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-57b84485-413e-4dca-9689-434bb639f568 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:28.402803 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-57b84485-413e-4dca-9689-434bb639f568 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:28.568073 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-57b84485-413e-4dca-9689-434bb639f568 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047e841cefdd4975947b2c154412953b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741ee13164894b49be1a0fc6c1385a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:28.577645 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-57b84485-413e-4dca-9689-434bb639f568 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] 10.222.0.70 "GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51" status: 200 len: 1758 microversion: 2.1 time: 0.188605 Jun 16 19:03:28.578520 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 268/513] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:28 2022] GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51 => generated 1758 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:28.804716 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-be48ebfb-4d17-4f74-841a-55c597338c06 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:03:28.805932 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-be48ebfb-4d17-4f74-841a-55c597338c06 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:28.812331 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-be48ebfb-4d17-4f74-841a-55c597338c06 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:28.812780 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-be48ebfb-4d17-4f74-841a-55c597338c06 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:28.813533 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-be48ebfb-4d17-4f74-841a-55c597338c06 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:28.813962 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-be48ebfb-4d17-4f74-841a-55c597338c06 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:28.837058 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.objects.instance [None req-be48ebfb-4d17-4f74-841a-55c597338c06 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lazy-loading 'flavor' on Instance uuid fdd6d861-ef2f-4b74-ba61-41178438391f {{(pid=117850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:03:28.963112 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-be48ebfb-4d17-4f74-841a-55c597338c06 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "POST /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f/action" status: 200 len: 32 microversion: 2.1 time: 0.163139 Jun 16 19:03:28.963738 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 246/514] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Jun 16 19:03:28 2022] POST /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f/action => generated 32 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 19:03:28.972603 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-d7e0cfa8-e44e-4a19-9576-857b431160bb tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:28.973228 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-d7e0cfa8-e44e-4a19-9576-857b431160bb tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:28.980178 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d7e0cfa8-e44e-4a19-9576-857b431160bb tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:28.980638 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d7e0cfa8-e44e-4a19-9576-857b431160bb tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:28.981412 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d7e0cfa8-e44e-4a19-9576-857b431160bb tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:28.981852 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d7e0cfa8-e44e-4a19-9576-857b431160bb tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:29.211665 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-d7e0cfa8-e44e-4a19-9576-857b431160bb tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:29.219849 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-d7e0cfa8-e44e-4a19-9576-857b431160bb tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f" status: 200 len: 1737 microversion: 2.1 time: 0.251052 Jun 16 19:03:29.220410 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 269/515] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:28 2022] GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f => generated 1737 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:29.595636 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-5f52084f-5145-4961-aa49-6f931a9fb01b tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:29.596366 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-5f52084f-5145-4961-aa49-6f931a9fb01b tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] [instance: edce90bf-b3d6-49de-a45f-9b65e1759b51] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:29.603732 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-5f52084f-5145-4961-aa49-6f931a9fb01b tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:29.604180 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-5f52084f-5145-4961-aa49-6f931a9fb01b tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:29.604953 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-5f52084f-5145-4961-aa49-6f931a9fb01b tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:29.605381 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-5f52084f-5145-4961-aa49-6f931a9fb01b tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:29.756607 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-5f52084f-5145-4961-aa49-6f931a9fb01b tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047e841cefdd4975947b2c154412953b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741ee13164894b49be1a0fc6c1385a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:29.765953 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-5f52084f-5145-4961-aa49-6f931a9fb01b tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] 10.222.0.70 "GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51" status: 200 len: 1758 microversion: 2.1 time: 0.174497 Jun 16 19:03:29.766514 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 247/516] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:29 2022] GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51 => generated 1758 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:30.237412 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-22a501c7-6306-42a5-92ff-bc4aa1b4f01e tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:30.237954 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-22a501c7-6306-42a5-92ff-bc4aa1b4f01e tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:30.245542 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-22a501c7-6306-42a5-92ff-bc4aa1b4f01e tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:30.245988 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-22a501c7-6306-42a5-92ff-bc4aa1b4f01e tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:30.246787 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-22a501c7-6306-42a5-92ff-bc4aa1b4f01e tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:30.247222 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-22a501c7-6306-42a5-92ff-bc4aa1b4f01e tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:30.377444 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-22a501c7-6306-42a5-92ff-bc4aa1b4f01e tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:30.386233 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-22a501c7-6306-42a5-92ff-bc4aa1b4f01e tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f" status: 200 len: 1737 microversion: 2.1 time: 0.152717 Jun 16 19:03:30.386832 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 270/517] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:30 2022] GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:30.783600 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-02ba1be4-1f38-45b0-a2c6-5b38858c5f8e tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:30.784215 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-02ba1be4-1f38-45b0-a2c6-5b38858c5f8e tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] [instance: edce90bf-b3d6-49de-a45f-9b65e1759b51] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:30.791469 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-02ba1be4-1f38-45b0-a2c6-5b38858c5f8e tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:30.791907 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-02ba1be4-1f38-45b0-a2c6-5b38858c5f8e tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:30.792665 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-02ba1be4-1f38-45b0-a2c6-5b38858c5f8e tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:30.793094 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-02ba1be4-1f38-45b0-a2c6-5b38858c5f8e tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:30.939408 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-02ba1be4-1f38-45b0-a2c6-5b38858c5f8e tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047e841cefdd4975947b2c154412953b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741ee13164894b49be1a0fc6c1385a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:30.949705 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-02ba1be4-1f38-45b0-a2c6-5b38858c5f8e tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] 10.222.0.70 "GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51" status: 200 len: 1758 microversion: 2.1 time: 0.169852 Jun 16 19:03:30.950324 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 248/518] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:30 2022] GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51 => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:31.403800 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-bc10878a-a4c6-4c70-8c45-d5ff7eb4b869 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:31.404336 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-bc10878a-a4c6-4c70-8c45-d5ff7eb4b869 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:31.410753 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-bc10878a-a4c6-4c70-8c45-d5ff7eb4b869 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:31.411198 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-bc10878a-a4c6-4c70-8c45-d5ff7eb4b869 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:31.411947 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-bc10878a-a4c6-4c70-8c45-d5ff7eb4b869 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:31.412375 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-bc10878a-a4c6-4c70-8c45-d5ff7eb4b869 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:31.549428 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-bc10878a-a4c6-4c70-8c45-d5ff7eb4b869 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:31.558033 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-bc10878a-a4c6-4c70-8c45-d5ff7eb4b869 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f" status: 200 len: 1737 microversion: 2.1 time: 0.158430 Jun 16 19:03:31.558614 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 271/519] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:31 2022] GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:31.967353 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-932e250d-402d-4418-8c33-a24eff5a2db3 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:31.967976 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-932e250d-402d-4418-8c33-a24eff5a2db3 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] [instance: edce90bf-b3d6-49de-a45f-9b65e1759b51] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:31.974435 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-932e250d-402d-4418-8c33-a24eff5a2db3 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:31.974922 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-932e250d-402d-4418-8c33-a24eff5a2db3 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:31.976355 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-932e250d-402d-4418-8c33-a24eff5a2db3 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:31.976827 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-932e250d-402d-4418-8c33-a24eff5a2db3 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:32.120242 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-932e250d-402d-4418-8c33-a24eff5a2db3 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047e841cefdd4975947b2c154412953b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741ee13164894b49be1a0fc6c1385a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:32.128185 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-932e250d-402d-4418-8c33-a24eff5a2db3 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] 10.222.0.70 "GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51" status: 200 len: 1758 microversion: 2.1 time: 0.164781 Jun 16 19:03:32.128740 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 249/520] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:31 2022] GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51 => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:32.576140 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-b71e388d-0a59-41dd-8ada-4bd6c7b4a1ae tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:32.576726 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-b71e388d-0a59-41dd-8ada-4bd6c7b4a1ae tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:32.582740 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-b71e388d-0a59-41dd-8ada-4bd6c7b4a1ae tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:32.583194 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-b71e388d-0a59-41dd-8ada-4bd6c7b4a1ae tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:32.583948 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-b71e388d-0a59-41dd-8ada-4bd6c7b4a1ae tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:32.584382 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-b71e388d-0a59-41dd-8ada-4bd6c7b4a1ae tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:32.717982 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-b71e388d-0a59-41dd-8ada-4bd6c7b4a1ae tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:32.725993 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-b71e388d-0a59-41dd-8ada-4bd6c7b4a1ae tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f" status: 200 len: 1737 microversion: 2.1 time: 0.154260 Jun 16 19:03:32.726753 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 272/521] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:32 2022] GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:33.145168 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-23f64c1f-e32d-4c54-a714-d3fd8ab46e09 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:33.145777 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-23f64c1f-e32d-4c54-a714-d3fd8ab46e09 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] [instance: edce90bf-b3d6-49de-a45f-9b65e1759b51] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:33.153068 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-23f64c1f-e32d-4c54-a714-d3fd8ab46e09 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:33.153519 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-23f64c1f-e32d-4c54-a714-d3fd8ab46e09 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:33.154271 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-23f64c1f-e32d-4c54-a714-d3fd8ab46e09 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:33.154737 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-23f64c1f-e32d-4c54-a714-d3fd8ab46e09 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:33.305392 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-23f64c1f-e32d-4c54-a714-d3fd8ab46e09 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047e841cefdd4975947b2c154412953b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741ee13164894b49be1a0fc6c1385a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:33.313631 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-23f64c1f-e32d-4c54-a714-d3fd8ab46e09 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] 10.222.0.70 "GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51" status: 200 len: 1758 microversion: 2.1 time: 0.172258 Jun 16 19:03:33.314196 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 250/522] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:33 2022] GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51 => generated 1758 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:33.743403 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-9978f507-1407-4cdf-b580-fa2664822f5b tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:33.744012 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-9978f507-1407-4cdf-b580-fa2664822f5b tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:33.750548 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-9978f507-1407-4cdf-b580-fa2664822f5b tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:33.751014 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-9978f507-1407-4cdf-b580-fa2664822f5b tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:33.751769 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-9978f507-1407-4cdf-b580-fa2664822f5b tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:33.752203 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-9978f507-1407-4cdf-b580-fa2664822f5b tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:33.879754 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-9978f507-1407-4cdf-b580-fa2664822f5b tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:33.888603 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-9978f507-1407-4cdf-b580-fa2664822f5b tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f" status: 200 len: 1737 microversion: 2.1 time: 0.149434 Jun 16 19:03:33.889161 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 273/523] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:33 2022] GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:34.330895 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-3d4add38-5679-4d60-b2ed-301970a3d5d7 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:34.331549 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-3d4add38-5679-4d60-b2ed-301970a3d5d7 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] [instance: edce90bf-b3d6-49de-a45f-9b65e1759b51] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:34.338775 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-3d4add38-5679-4d60-b2ed-301970a3d5d7 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:34.339231 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-3d4add38-5679-4d60-b2ed-301970a3d5d7 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:34.340044 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-3d4add38-5679-4d60-b2ed-301970a3d5d7 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:34.340529 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-3d4add38-5679-4d60-b2ed-301970a3d5d7 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:34.487907 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-3d4add38-5679-4d60-b2ed-301970a3d5d7 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047e841cefdd4975947b2c154412953b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741ee13164894b49be1a0fc6c1385a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:34.497709 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-3d4add38-5679-4d60-b2ed-301970a3d5d7 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] 10.222.0.70 "GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51" status: 200 len: 1758 microversion: 2.1 time: 0.170943 Jun 16 19:03:34.498275 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 251/524] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:34 2022] GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51 => generated 1758 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:34.906378 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-23db7393-7131-4113-9a23-7f468ac632c3 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:34.907041 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-23db7393-7131-4113-9a23-7f468ac632c3 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:34.914333 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-23db7393-7131-4113-9a23-7f468ac632c3 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:34.914804 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-23db7393-7131-4113-9a23-7f468ac632c3 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:34.915568 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-23db7393-7131-4113-9a23-7f468ac632c3 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:34.915994 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-23db7393-7131-4113-9a23-7f468ac632c3 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:35.056732 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-23db7393-7131-4113-9a23-7f468ac632c3 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:35.064695 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-23db7393-7131-4113-9a23-7f468ac632c3 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f" status: 200 len: 1737 microversion: 2.1 time: 0.162194 Jun 16 19:03:35.065243 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 274/525] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:34 2022] GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:35.515954 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-ac308526-87bb-4b60-96f0-6e9f80e624aa tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:35.516565 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-ac308526-87bb-4b60-96f0-6e9f80e624aa tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] [instance: edce90bf-b3d6-49de-a45f-9b65e1759b51] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:35.525459 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-ac308526-87bb-4b60-96f0-6e9f80e624aa tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:35.525990 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-ac308526-87bb-4b60-96f0-6e9f80e624aa tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:35.526978 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-ac308526-87bb-4b60-96f0-6e9f80e624aa tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:35.527977 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-ac308526-87bb-4b60-96f0-6e9f80e624aa tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:35.675943 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-ac308526-87bb-4b60-96f0-6e9f80e624aa tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047e841cefdd4975947b2c154412953b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741ee13164894b49be1a0fc6c1385a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:35.685183 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-ac308526-87bb-4b60-96f0-6e9f80e624aa tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] 10.222.0.70 "GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51" status: 200 len: 1758 microversion: 2.1 time: 0.173067 Jun 16 19:03:35.685756 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 252/526] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:35 2022] GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51 => generated 1758 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:03:36.082064 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-f2cf25b2-60d3-41d5-b1df-8386c97f09da tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:36.082702 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-f2cf25b2-60d3-41d5-b1df-8386c97f09da tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:36.089601 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f2cf25b2-60d3-41d5-b1df-8386c97f09da tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:36.090180 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f2cf25b2-60d3-41d5-b1df-8386c97f09da tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:36.091099 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f2cf25b2-60d3-41d5-b1df-8386c97f09da tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:36.091543 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f2cf25b2-60d3-41d5-b1df-8386c97f09da tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:36.222141 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-f2cf25b2-60d3-41d5-b1df-8386c97f09da tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:36.226370 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:03:36.231687 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-f2cf25b2-60d3-41d5-b1df-8386c97f09da tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f" status: 200 len: 1737 microversion: 2.1 time: 0.153561 Jun 16 19:03:36.232507 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 275/527] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:36 2022] GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:36.703310 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-be959a56-da71-4707-8b21-08bbf6a5a5b4 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:36.703920 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-be959a56-da71-4707-8b21-08bbf6a5a5b4 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] [instance: edce90bf-b3d6-49de-a45f-9b65e1759b51] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:36.710281 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-be959a56-da71-4707-8b21-08bbf6a5a5b4 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:36.710765 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-be959a56-da71-4707-8b21-08bbf6a5a5b4 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:36.711525 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-be959a56-da71-4707-8b21-08bbf6a5a5b4 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:36.711957 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-be959a56-da71-4707-8b21-08bbf6a5a5b4 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:36.856960 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-be959a56-da71-4707-8b21-08bbf6a5a5b4 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047e841cefdd4975947b2c154412953b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741ee13164894b49be1a0fc6c1385a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:36.865059 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-be959a56-da71-4707-8b21-08bbf6a5a5b4 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] 10.222.0.70 "GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51" status: 200 len: 1758 microversion: 2.1 time: 0.165579 Jun 16 19:03:36.865619 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 253/528] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:36 2022] GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51 => generated 1758 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:37.249389 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-1861cecd-e763-4fc2-827a-82e946d41de0 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:37.249977 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-1861cecd-e763-4fc2-827a-82e946d41de0 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:37.257691 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-1861cecd-e763-4fc2-827a-82e946d41de0 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:37.258139 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-1861cecd-e763-4fc2-827a-82e946d41de0 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:37.258935 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-1861cecd-e763-4fc2-827a-82e946d41de0 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:37.259366 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-1861cecd-e763-4fc2-827a-82e946d41de0 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:37.391041 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-1861cecd-e763-4fc2-827a-82e946d41de0 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:37.399975 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-1861cecd-e763-4fc2-827a-82e946d41de0 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f" status: 200 len: 1737 microversion: 2.1 time: 0.155128 Jun 16 19:03:37.400799 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 276/529] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:37 2022] GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:37.884105 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-9d6d958d-ce77-40bd-b4c2-433bc58bcad6 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:37.884712 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-9d6d958d-ce77-40bd-b4c2-433bc58bcad6 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] [instance: edce90bf-b3d6-49de-a45f-9b65e1759b51] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:37.891342 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-9d6d958d-ce77-40bd-b4c2-433bc58bcad6 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:37.891784 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-9d6d958d-ce77-40bd-b4c2-433bc58bcad6 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:37.892536 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-9d6d958d-ce77-40bd-b4c2-433bc58bcad6 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:37.892969 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-9d6d958d-ce77-40bd-b4c2-433bc58bcad6 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:38.036591 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-9d6d958d-ce77-40bd-b4c2-433bc58bcad6 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047e841cefdd4975947b2c154412953b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741ee13164894b49be1a0fc6c1385a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:38.045159 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-9d6d958d-ce77-40bd-b4c2-433bc58bcad6 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] 10.222.0.70 "GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51" status: 200 len: 1758 microversion: 2.1 time: 0.165759 Jun 16 19:03:38.045749 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 254/530] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:37 2022] GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51 => generated 1758 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:38.417888 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-25f497c6-7ee9-47a3-9f1a-b6c7df4ca8a5 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:38.418414 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-25f497c6-7ee9-47a3-9f1a-b6c7df4ca8a5 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:38.424943 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-25f497c6-7ee9-47a3-9f1a-b6c7df4ca8a5 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:38.425392 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-25f497c6-7ee9-47a3-9f1a-b6c7df4ca8a5 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:38.426151 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-25f497c6-7ee9-47a3-9f1a-b6c7df4ca8a5 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:38.426604 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-25f497c6-7ee9-47a3-9f1a-b6c7df4ca8a5 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:38.559832 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-25f497c6-7ee9-47a3-9f1a-b6c7df4ca8a5 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:38.567753 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-25f497c6-7ee9-47a3-9f1a-b6c7df4ca8a5 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f" status: 200 len: 1737 microversion: 2.1 time: 0.153901 Jun 16 19:03:38.568313 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 277/531] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:38 2022] GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:39.062824 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-33c71243-8806-4fb3-9a21-d6346be95f53 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:39.063435 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-33c71243-8806-4fb3-9a21-d6346be95f53 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] [instance: edce90bf-b3d6-49de-a45f-9b65e1759b51] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:39.070629 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-33c71243-8806-4fb3-9a21-d6346be95f53 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:39.071075 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-33c71243-8806-4fb3-9a21-d6346be95f53 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:39.071833 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-33c71243-8806-4fb3-9a21-d6346be95f53 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:39.072264 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-33c71243-8806-4fb3-9a21-d6346be95f53 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:39.091563 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:03:39.220773 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-33c71243-8806-4fb3-9a21-d6346be95f53 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047e841cefdd4975947b2c154412953b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741ee13164894b49be1a0fc6c1385a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:39.229041 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-33c71243-8806-4fb3-9a21-d6346be95f53 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] 10.222.0.70 "GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51" status: 200 len: 1758 microversion: 2.1 time: 0.170179 Jun 16 19:03:39.229604 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 255/532] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:39 2022] GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51 => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:39.584689 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-63fbff97-ccf0-4506-9a92-7fcc1a7ab1b6 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:39.585271 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-63fbff97-ccf0-4506-9a92-7fcc1a7ab1b6 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:39.591869 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-63fbff97-ccf0-4506-9a92-7fcc1a7ab1b6 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:39.592319 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-63fbff97-ccf0-4506-9a92-7fcc1a7ab1b6 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:39.593079 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-63fbff97-ccf0-4506-9a92-7fcc1a7ab1b6 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:39.593517 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-63fbff97-ccf0-4506-9a92-7fcc1a7ab1b6 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:39.730501 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-63fbff97-ccf0-4506-9a92-7fcc1a7ab1b6 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:39.738593 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-63fbff97-ccf0-4506-9a92-7fcc1a7ab1b6 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f" status: 200 len: 1737 microversion: 2.1 time: 0.157822 Jun 16 19:03:39.739446 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 278/533] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:39 2022] GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:40.246391 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-a3fa7eac-872a-470e-a1c6-4b35a8759cdb tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:40.250583 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-a3fa7eac-872a-470e-a1c6-4b35a8759cdb tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] [instance: edce90bf-b3d6-49de-a45f-9b65e1759b51] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:40.253890 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-a3fa7eac-872a-470e-a1c6-4b35a8759cdb tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:40.254337 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-a3fa7eac-872a-470e-a1c6-4b35a8759cdb tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:40.255119 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-a3fa7eac-872a-470e-a1c6-4b35a8759cdb tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:40.255545 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-a3fa7eac-872a-470e-a1c6-4b35a8759cdb tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:40.399344 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-a3fa7eac-872a-470e-a1c6-4b35a8759cdb tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047e841cefdd4975947b2c154412953b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741ee13164894b49be1a0fc6c1385a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:40.407567 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-a3fa7eac-872a-470e-a1c6-4b35a8759cdb tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] 10.222.0.70 "GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51" status: 200 len: 1758 microversion: 2.1 time: 0.165163 Jun 16 19:03:40.408129 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 256/534] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:40 2022] GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51 => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:03:40.756042 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-f9453ca9-2ffd-4d11-b167-37cda5ff588c tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:40.757506 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-f9453ca9-2ffd-4d11-b167-37cda5ff588c tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:40.763789 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f9453ca9-2ffd-4d11-b167-37cda5ff588c tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:40.764244 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f9453ca9-2ffd-4d11-b167-37cda5ff588c tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:40.765010 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f9453ca9-2ffd-4d11-b167-37cda5ff588c tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:40.765440 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f9453ca9-2ffd-4d11-b167-37cda5ff588c tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:40.908688 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-f9453ca9-2ffd-4d11-b167-37cda5ff588c tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:40.929422 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-f9453ca9-2ffd-4d11-b167-37cda5ff588c tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f" status: 200 len: 1737 microversion: 2.1 time: 0.175064 Jun 16 19:03:40.930373 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 279/535] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:40 2022] GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f => generated 1737 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:41.425619 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-f0749d62-81b4-4a04-a095-366e83fbff9c tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:41.426235 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-f0749d62-81b4-4a04-a095-366e83fbff9c tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] [instance: edce90bf-b3d6-49de-a45f-9b65e1759b51] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:41.433351 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-f0749d62-81b4-4a04-a095-366e83fbff9c tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:41.433799 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-f0749d62-81b4-4a04-a095-366e83fbff9c tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:41.434555 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-f0749d62-81b4-4a04-a095-366e83fbff9c tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:41.435020 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-f0749d62-81b4-4a04-a095-366e83fbff9c tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:41.581862 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-f0749d62-81b4-4a04-a095-366e83fbff9c tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047e841cefdd4975947b2c154412953b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741ee13164894b49be1a0fc6c1385a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:41.590095 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-f0749d62-81b4-4a04-a095-366e83fbff9c tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] 10.222.0.70 "GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51" status: 200 len: 1758 microversion: 2.1 time: 0.168345 Jun 16 19:03:41.590676 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 257/536] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:41 2022] GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51 => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:41.947053 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-4f139abf-1236-43c1-9197-fa38c77f999d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:41.947729 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-4f139abf-1236-43c1-9197-fa38c77f999d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:41.954192 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-4f139abf-1236-43c1-9197-fa38c77f999d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:41.954673 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-4f139abf-1236-43c1-9197-fa38c77f999d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:41.955440 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-4f139abf-1236-43c1-9197-fa38c77f999d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:41.955873 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-4f139abf-1236-43c1-9197-fa38c77f999d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:42.086930 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-4f139abf-1236-43c1-9197-fa38c77f999d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:42.094951 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-4f139abf-1236-43c1-9197-fa38c77f999d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f" status: 200 len: 1737 microversion: 2.1 time: 0.152008 Jun 16 19:03:42.095514 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 280/537] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:41 2022] GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:42.607163 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-6509508d-e0c6-426e-8171-b8cb1b6ca060 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:42.607778 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-6509508d-e0c6-426e-8171-b8cb1b6ca060 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] [instance: edce90bf-b3d6-49de-a45f-9b65e1759b51] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:42.614459 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-6509508d-e0c6-426e-8171-b8cb1b6ca060 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:42.614984 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-6509508d-e0c6-426e-8171-b8cb1b6ca060 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:42.615879 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-6509508d-e0c6-426e-8171-b8cb1b6ca060 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:42.616325 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-6509508d-e0c6-426e-8171-b8cb1b6ca060 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:42.759804 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-6509508d-e0c6-426e-8171-b8cb1b6ca060 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047e841cefdd4975947b2c154412953b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741ee13164894b49be1a0fc6c1385a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:42.767822 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-6509508d-e0c6-426e-8171-b8cb1b6ca060 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] 10.222.0.70 "GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51" status: 200 len: 1758 microversion: 2.1 time: 0.164602 Jun 16 19:03:42.768387 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 258/538] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:42 2022] GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51 => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:43.111966 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-916907b2-25a8-4a89-90a1-794a23b63deb tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:43.112579 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-916907b2-25a8-4a89-90a1-794a23b63deb tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:43.119930 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-916907b2-25a8-4a89-90a1-794a23b63deb tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:43.120483 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-916907b2-25a8-4a89-90a1-794a23b63deb tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:43.121253 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-916907b2-25a8-4a89-90a1-794a23b63deb tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:43.121690 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-916907b2-25a8-4a89-90a1-794a23b63deb tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:43.271765 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-916907b2-25a8-4a89-90a1-794a23b63deb tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:43.281149 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-916907b2-25a8-4a89-90a1-794a23b63deb tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f" status: 200 len: 1737 microversion: 2.1 time: 0.172958 Jun 16 19:03:43.281716 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 281/539] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:43 2022] GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f => generated 1737 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:43.429665 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-9e92dbb6-ce0b-4147-a002-5f12c5c43885 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:43.430166 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-9e92dbb6-ce0b-4147-a002-5f12c5c43885 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:43.436219 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-9e92dbb6-ce0b-4147-a002-5f12c5c43885 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:43.436669 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-9e92dbb6-ce0b-4147-a002-5f12c5c43885 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:43.437427 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-9e92dbb6-ce0b-4147-a002-5f12c5c43885 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:43.437869 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-9e92dbb6-ce0b-4147-a002-5f12c5c43885 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:43.563771 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.objects.instance [None req-9e92dbb6-ce0b-4147-a002-5f12c5c43885 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lazy-loading 'services' on Instance uuid 2fb4cc0a-23a8-417c-a8a1-35501c2690ee {{(pid=117850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:03:43.692768 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-9e92dbb6-ce0b-4147-a002-5f12c5c43885 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "DELETE /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee/os-volume_attachments/cbdcf7d3-51cc-44bd-92f8-90a9d9895c57" status: 202 len: 0 microversion: 2.1 time: 0.267870 Jun 16 19:03:43.693507 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 259/540] 10.222.0.70 () {58 vars in 1415 bytes} [Thu Jun 16 19:03:43 2022] DELETE /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee/os-volume_attachments/cbdcf7d3-51cc-44bd-92f8-90a9d9895c57 => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:03:43.785757 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-8edcea07-7277-4ea5-bc07-a04746642ebb tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:43.786287 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-8edcea07-7277-4ea5-bc07-a04746642ebb tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] [instance: edce90bf-b3d6-49de-a45f-9b65e1759b51] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:43.792994 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-8edcea07-7277-4ea5-bc07-a04746642ebb tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:43.793440 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-8edcea07-7277-4ea5-bc07-a04746642ebb tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:43.794217 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-8edcea07-7277-4ea5-bc07-a04746642ebb tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:43.794676 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-8edcea07-7277-4ea5-bc07-a04746642ebb tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:43.938750 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-8edcea07-7277-4ea5-bc07-a04746642ebb tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047e841cefdd4975947b2c154412953b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741ee13164894b49be1a0fc6c1385a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:43.951092 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-8edcea07-7277-4ea5-bc07-a04746642ebb tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] 10.222.0.70 "GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51" status: 200 len: 1758 microversion: 2.1 time: 0.168719 Jun 16 19:03:43.951268 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 282/541] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:43 2022] GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51 => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:44.299025 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-9d613ecf-edaf-4480-88b1-3190d9b3b837 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:44.299657 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-9d613ecf-edaf-4480-88b1-3190d9b3b837 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:44.306757 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-9d613ecf-edaf-4480-88b1-3190d9b3b837 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:44.307206 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-9d613ecf-edaf-4480-88b1-3190d9b3b837 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:44.307966 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-9d613ecf-edaf-4480-88b1-3190d9b3b837 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:44.308396 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-9d613ecf-edaf-4480-88b1-3190d9b3b837 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:44.436470 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-9d613ecf-edaf-4480-88b1-3190d9b3b837 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:44.445404 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-9d613ecf-edaf-4480-88b1-3190d9b3b837 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f" status: 200 len: 1737 microversion: 2.1 time: 0.150493 Jun 16 19:03:44.445962 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 260/542] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:44 2022] GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:44.969280 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-ee37ddb7-7cb5-4690-bbf1-b1b24fa8553f tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:44.969901 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-ee37ddb7-7cb5-4690-bbf1-b1b24fa8553f tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] [instance: edce90bf-b3d6-49de-a45f-9b65e1759b51] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:44.977245 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ee37ddb7-7cb5-4690-bbf1-b1b24fa8553f tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:44.977702 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ee37ddb7-7cb5-4690-bbf1-b1b24fa8553f tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:44.978483 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ee37ddb7-7cb5-4690-bbf1-b1b24fa8553f tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:44.978946 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ee37ddb7-7cb5-4690-bbf1-b1b24fa8553f tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:45.136899 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-ee37ddb7-7cb5-4690-bbf1-b1b24fa8553f tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047e841cefdd4975947b2c154412953b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741ee13164894b49be1a0fc6c1385a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:45.145073 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-ee37ddb7-7cb5-4690-bbf1-b1b24fa8553f tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] 10.222.0.70 "GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51" status: 200 len: 1758 microversion: 2.1 time: 0.179738 Jun 16 19:03:45.145644 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 283/543] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:44 2022] GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51 => generated 1758 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:45.462495 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-182654a6-a26e-4702-bff9-a3500a6b3a5c tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:45.463152 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-182654a6-a26e-4702-bff9-a3500a6b3a5c tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:45.469587 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-182654a6-a26e-4702-bff9-a3500a6b3a5c tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:45.470040 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-182654a6-a26e-4702-bff9-a3500a6b3a5c tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:45.470834 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-182654a6-a26e-4702-bff9-a3500a6b3a5c tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:45.471314 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-182654a6-a26e-4702-bff9-a3500a6b3a5c tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:45.603899 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-182654a6-a26e-4702-bff9-a3500a6b3a5c tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:45.611783 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-182654a6-a26e-4702-bff9-a3500a6b3a5c tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f" status: 200 len: 1737 microversion: 2.1 time: 0.153239 Jun 16 19:03:45.612331 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 261/544] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:45 2022] GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:46.163954 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-3a5830cc-be5d-447e-ad2e-955cbf8d4e74 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:46.164494 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-3a5830cc-be5d-447e-ad2e-955cbf8d4e74 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] [instance: edce90bf-b3d6-49de-a45f-9b65e1759b51] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:46.171383 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-3a5830cc-be5d-447e-ad2e-955cbf8d4e74 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:46.171833 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-3a5830cc-be5d-447e-ad2e-955cbf8d4e74 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:46.172593 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-3a5830cc-be5d-447e-ad2e-955cbf8d4e74 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:46.173028 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-3a5830cc-be5d-447e-ad2e-955cbf8d4e74 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:46.315914 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-3a5830cc-be5d-447e-ad2e-955cbf8d4e74 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047e841cefdd4975947b2c154412953b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741ee13164894b49be1a0fc6c1385a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:46.324590 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-3a5830cc-be5d-447e-ad2e-955cbf8d4e74 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] 10.222.0.70 "GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51" status: 200 len: 1761 microversion: 2.1 time: 0.165109 Jun 16 19:03:46.325140 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 284/545] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:46 2022] GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51 => generated 1761 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:46.629351 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-98ccf91b-a971-448b-9556-121026e0810d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:46.629969 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-98ccf91b-a971-448b-9556-121026e0810d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:46.637445 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-98ccf91b-a971-448b-9556-121026e0810d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:46.637896 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-98ccf91b-a971-448b-9556-121026e0810d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:46.638696 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-98ccf91b-a971-448b-9556-121026e0810d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:46.639135 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-98ccf91b-a971-448b-9556-121026e0810d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:46.770741 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-98ccf91b-a971-448b-9556-121026e0810d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:46.779802 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-98ccf91b-a971-448b-9556-121026e0810d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f" status: 200 len: 1737 microversion: 2.1 time: 0.154247 Jun 16 19:03:46.780386 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 262/546] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:46 2022] GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:47.797909 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-cf7b292d-8ec7-4056-9d69-c5d8008bb31e tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:47.798526 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-cf7b292d-8ec7-4056-9d69-c5d8008bb31e tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:47.807827 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-cf7b292d-8ec7-4056-9d69-c5d8008bb31e tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:47.808281 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-cf7b292d-8ec7-4056-9d69-c5d8008bb31e tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:47.809054 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-cf7b292d-8ec7-4056-9d69-c5d8008bb31e tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:47.809490 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-cf7b292d-8ec7-4056-9d69-c5d8008bb31e tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:47.941373 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-cf7b292d-8ec7-4056-9d69-c5d8008bb31e tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:47.950229 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-cf7b292d-8ec7-4056-9d69-c5d8008bb31e tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f" status: 200 len: 1737 microversion: 2.1 time: 0.156160 Jun 16 19:03:47.950822 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 285/547] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:47 2022] GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:48.970071 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-b9aee640-8d55-48e7-8cdc-6a3d2a64dc00 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:48.971428 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-b9aee640-8d55-48e7-8cdc-6a3d2a64dc00 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:48.980545 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b9aee640-8d55-48e7-8cdc-6a3d2a64dc00 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:48.980995 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b9aee640-8d55-48e7-8cdc-6a3d2a64dc00 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:48.981758 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b9aee640-8d55-48e7-8cdc-6a3d2a64dc00 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:48.982243 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b9aee640-8d55-48e7-8cdc-6a3d2a64dc00 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:49.129438 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-b9aee640-8d55-48e7-8cdc-6a3d2a64dc00 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:49.138728 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-b9aee640-8d55-48e7-8cdc-6a3d2a64dc00 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f" status: 200 len: 1737 microversion: 2.1 time: 0.174424 Jun 16 19:03:49.139524 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 263/548] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:48 2022] GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f => generated 1737 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:50.116936 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-6e4d7aca-5132-4fa1-936b-8cbddd497945 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:03:50.119421 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_api:SELECT=47 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:03:50.124895 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-6e4d7aca-5132-4fa1-936b-8cbddd497945 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:50.125451 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-6e4d7aca-5132-4fa1-936b-8cbddd497945 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:50.147695 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-6e4d7aca-5132-4fa1-936b-8cbddd497945 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Going to try to stop instance {{(pid=117852) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 16 19:03:50.158974 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-9b3c173b-c3d1-419b-9cd6-84231764a488 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:50.159602 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-9b3c173b-c3d1-419b-9cd6-84231764a488 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:50.161813 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_api:SELECT=47 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:03:50.167553 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-9b3c173b-c3d1-419b-9cd6-84231764a488 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:50.168032 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-9b3c173b-c3d1-419b-9cd6-84231764a488 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:50.168825 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-9b3c173b-c3d1-419b-9cd6-84231764a488 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:50.169290 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-9b3c173b-c3d1-419b-9cd6-84231764a488 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:50.191437 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-6e4d7aca-5132-4fa1-936b-8cbddd497945 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "POST /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee/action" status: 202 len: 0 microversion: 2.1 time: 0.078877 Jun 16 19:03:50.192081 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 286/549] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Jun 16 19:03:50 2022] POST /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:03:50.200658 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-12349bcd-f649-46a6-8ef6-8f4c517f9a82 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:50.201292 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-12349bcd-f649-46a6-8ef6-8f4c517f9a82 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:50.207613 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-12349bcd-f649-46a6-8ef6-8f4c517f9a82 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:50.208070 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-12349bcd-f649-46a6-8ef6-8f4c517f9a82 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:50.208843 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-12349bcd-f649-46a6-8ef6-8f4c517f9a82 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:50.209890 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-12349bcd-f649-46a6-8ef6-8f4c517f9a82 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:50.306460 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-9b3c173b-c3d1-419b-9cd6-84231764a488 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:50.314945 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-9b3c173b-c3d1-419b-9cd6-84231764a488 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f" status: 200 len: 1737 microversion: 2.1 time: 0.159945 Jun 16 19:03:50.315750 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 264/550] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:50 2022] GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:03:50.359403 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-12349bcd-f649-46a6-8ef6-8f4c517f9a82 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:50.367168 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-12349bcd-f649-46a6-8ef6-8f4c517f9a82 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1676 microversion: 2.1 time: 0.170635 Jun 16 19:03:50.367737 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 287/551] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:50 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1676 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:03:51.332578 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-3a6038aa-e6a8-486d-8e1c-b7d21f910720 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:51.333190 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-3a6038aa-e6a8-486d-8e1c-b7d21f910720 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:51.340429 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-3a6038aa-e6a8-486d-8e1c-b7d21f910720 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:51.340878 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-3a6038aa-e6a8-486d-8e1c-b7d21f910720 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:51.341642 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-3a6038aa-e6a8-486d-8e1c-b7d21f910720 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:51.342072 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-3a6038aa-e6a8-486d-8e1c-b7d21f910720 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:51.385338 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-79e4c0c1-7805-4508-b812-92e88625829e tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:51.385892 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-79e4c0c1-7805-4508-b812-92e88625829e tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:51.392198 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-79e4c0c1-7805-4508-b812-92e88625829e tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:51.392651 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-79e4c0c1-7805-4508-b812-92e88625829e tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:51.393414 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-79e4c0c1-7805-4508-b812-92e88625829e tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:51.393849 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-79e4c0c1-7805-4508-b812-92e88625829e tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:51.474522 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-3a6038aa-e6a8-486d-8e1c-b7d21f910720 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:51.483503 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-3a6038aa-e6a8-486d-8e1c-b7d21f910720 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f" status: 200 len: 1737 microversion: 2.1 time: 0.154733 Jun 16 19:03:51.484081 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 265/552] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:51 2022] GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:51.527646 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-79e4c0c1-7805-4508-b812-92e88625829e tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:51.535036 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-79e4c0c1-7805-4508-b812-92e88625829e tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1676 microversion: 2.1 time: 0.154049 Jun 16 19:03:51.535599 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 288/553] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:51 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:03:52.501330 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-59bea1a8-f5fd-425f-8568-ae11072a8fa6 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:52.501984 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-59bea1a8-f5fd-425f-8568-ae11072a8fa6 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:52.509708 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-59bea1a8-f5fd-425f-8568-ae11072a8fa6 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:52.510154 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-59bea1a8-f5fd-425f-8568-ae11072a8fa6 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:52.510963 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-59bea1a8-f5fd-425f-8568-ae11072a8fa6 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:52.511395 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-59bea1a8-f5fd-425f-8568-ae11072a8fa6 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:52.553694 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-0ee9c05e-3de2-4e97-8de3-022da4b6cf83 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:52.555737 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-0ee9c05e-3de2-4e97-8de3-022da4b6cf83 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:52.562984 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-0ee9c05e-3de2-4e97-8de3-022da4b6cf83 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:52.563432 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-0ee9c05e-3de2-4e97-8de3-022da4b6cf83 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:52.564207 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-0ee9c05e-3de2-4e97-8de3-022da4b6cf83 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:52.564644 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-0ee9c05e-3de2-4e97-8de3-022da4b6cf83 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:52.649032 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-59bea1a8-f5fd-425f-8568-ae11072a8fa6 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:52.657317 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-59bea1a8-f5fd-425f-8568-ae11072a8fa6 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f" status: 200 len: 1737 microversion: 2.1 time: 0.159857 Jun 16 19:03:52.657893 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 266/554] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:52 2022] GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:52.699317 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-62537178-71b0-42fd-8599-e8e52dcfec0a tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:52.699922 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-62537178-71b0-42fd-8599-e8e52dcfec0a tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] [instance: 1e7cb911-e703-4b7d-98b6-18e49fe78d2e] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:52.708926 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-62537178-71b0-42fd-8599-e8e52dcfec0a tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:52.709720 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-62537178-71b0-42fd-8599-e8e52dcfec0a tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:52.711110 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-62537178-71b0-42fd-8599-e8e52dcfec0a tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:52.711857 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-62537178-71b0-42fd-8599-e8e52dcfec0a tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:52.806384 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.objects.instance [None req-62537178-71b0-42fd-8599-e8e52dcfec0a tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lazy-loading 'services' on Instance uuid 1e7cb911-e703-4b7d-98b6-18e49fe78d2e {{(pid=117850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:03:52.823705 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-0ee9c05e-3de2-4e97-8de3-022da4b6cf83 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:52.831344 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-0ee9c05e-3de2-4e97-8de3-022da4b6cf83 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1676 microversion: 2.1 time: 0.282299 Jun 16 19:03:52.831899 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 289/555] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:52 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1676 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:52.878220 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-62537178-71b0-42fd-8599-e8e52dcfec0a tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] 10.222.0.70 "DELETE /compute/v2.1/servers/1e7cb911-e703-4b7d-98b6-18e49fe78d2e/os-volume_attachments/de4d7601-4f85-4e1b-9ddc-e01fd21d6903" status: 202 len: 0 microversion: 2.1 time: 0.182839 Jun 16 19:03:52.878853 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 267/556] 10.222.0.70 () {58 vars in 1415 bytes} [Thu Jun 16 19:03:52 2022] DELETE /compute/v2.1/servers/1e7cb911-e703-4b7d-98b6-18e49fe78d2e/os-volume_attachments/de4d7601-4f85-4e1b-9ddc-e01fd21d6903 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 19:03:53.674920 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-fc95eecc-7e98-44ac-baa8-0c63fdd6fa74 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:53.675532 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-fc95eecc-7e98-44ac-baa8-0c63fdd6fa74 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:53.682339 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-fc95eecc-7e98-44ac-baa8-0c63fdd6fa74 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:53.682813 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-fc95eecc-7e98-44ac-baa8-0c63fdd6fa74 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:53.683582 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-fc95eecc-7e98-44ac-baa8-0c63fdd6fa74 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:53.684010 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-fc95eecc-7e98-44ac-baa8-0c63fdd6fa74 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:53.814479 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-fc95eecc-7e98-44ac-baa8-0c63fdd6fa74 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:53.825465 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-fc95eecc-7e98-44ac-baa8-0c63fdd6fa74 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f" status: 200 len: 1737 microversion: 2.1 time: 0.154438 Jun 16 19:03:53.826031 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 290/557] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:53 2022] GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:53.849308 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-844d5ce1-34c7-4447-88d1-95eaa87abc6c tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:53.850018 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-844d5ce1-34c7-4447-88d1-95eaa87abc6c tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:53.856338 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-844d5ce1-34c7-4447-88d1-95eaa87abc6c tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:53.856785 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-844d5ce1-34c7-4447-88d1-95eaa87abc6c tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:53.857532 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-844d5ce1-34c7-4447-88d1-95eaa87abc6c tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:53.857958 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-844d5ce1-34c7-4447-88d1-95eaa87abc6c tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:53.988535 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-844d5ce1-34c7-4447-88d1-95eaa87abc6c tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:53.996507 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-844d5ce1-34c7-4447-88d1-95eaa87abc6c tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1676 microversion: 2.1 time: 0.151823 Jun 16 19:03:53.997062 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 268/558] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:53 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:54.843834 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-1fc3c75a-525d-4325-abd3-5db62c65f910 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:54.845065 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-1fc3c75a-525d-4325-abd3-5db62c65f910 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:54.853690 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-1fc3c75a-525d-4325-abd3-5db62c65f910 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:54.854178 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-1fc3c75a-525d-4325-abd3-5db62c65f910 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:54.855291 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-1fc3c75a-525d-4325-abd3-5db62c65f910 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:54.856122 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-1fc3c75a-525d-4325-abd3-5db62c65f910 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:54.876344 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:03:54.991075 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-1fc3c75a-525d-4325-abd3-5db62c65f910 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:54.999204 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-1fc3c75a-525d-4325-abd3-5db62c65f910 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f" status: 200 len: 1717 microversion: 2.1 time: 0.160031 Jun 16 19:03:54.999801 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 291/559] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:54 2022] GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f => generated 1717 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:55.013688 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-ce6bf815-7bf1-480d-bb41-c8478b7b49c5 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:55.014379 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-ce6bf815-7bf1-480d-bb41-c8478b7b49c5 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:55.023538 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-ce6bf815-7bf1-480d-bb41-c8478b7b49c5 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:55.023999 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-ce6bf815-7bf1-480d-bb41-c8478b7b49c5 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:55.025017 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-ce6bf815-7bf1-480d-bb41-c8478b7b49c5 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:55.026084 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-ce6bf815-7bf1-480d-bb41-c8478b7b49c5 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:55.051523 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-ea9329d6-d630-4fe7-9a5a-d50c48d11faa tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:55.052276 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-ea9329d6-d630-4fe7-9a5a-d50c48d11faa tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] [instance: 1e7cb911-e703-4b7d-98b6-18e49fe78d2e] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:55.059557 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ea9329d6-d630-4fe7-9a5a-d50c48d11faa tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:55.060009 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ea9329d6-d630-4fe7-9a5a-d50c48d11faa tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:55.060761 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ea9329d6-d630-4fe7-9a5a-d50c48d11faa tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:55.061411 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ea9329d6-d630-4fe7-9a5a-d50c48d11faa tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:55.088238 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-ea9329d6-d630-4fe7-9a5a-d50c48d11faa tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] [instance: 1e7cb911-e703-4b7d-98b6-18e49fe78d2e] Going to try to terminate instance {{(pid=117852) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:03:55.170946 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-ea9329d6-d630-4fe7-9a5a-d50c48d11faa tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] 10.222.0.70 "DELETE /compute/v2.1/servers/1e7cb911-e703-4b7d-98b6-18e49fe78d2e" status: 204 len: 0 microversion: 2.1 time: 0.123103 Jun 16 19:03:55.174298 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-ce6bf815-7bf1-480d-bb41-c8478b7b49c5 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:55.175282 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 292/560] 10.222.0.70 () {58 vars in 1238 bytes} [Thu Jun 16 19:03:55 2022] DELETE /compute/v2.1/servers/1e7cb911-e703-4b7d-98b6-18e49fe78d2e => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 19:03:55.181336 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-92b978a0-29b6-46e2-9f4b-bda96b2f8a2a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:55.181926 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-92b978a0-29b6-46e2-9f4b-bda96b2f8a2a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:55.186014 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-ce6bf815-7bf1-480d-bb41-c8478b7b49c5 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1676 microversion: 2.1 time: 0.176569 Jun 16 19:03:55.186600 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 269/561] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:55 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1676 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:55.196188 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-92b978a0-29b6-46e2-9f4b-bda96b2f8a2a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:55.196188 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-92b978a0-29b6-46e2-9f4b-bda96b2f8a2a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:55.196188 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-92b978a0-29b6-46e2-9f4b-bda96b2f8a2a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:55.196188 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-92b978a0-29b6-46e2-9f4b-bda96b2f8a2a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:55.196523 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-d693a9e2-2294-4d68-bc11-fbcb3c8b6067 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:55.196523 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-d693a9e2-2294-4d68-bc11-fbcb3c8b6067 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] [instance: 1e7cb911-e703-4b7d-98b6-18e49fe78d2e] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:55.197928 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d693a9e2-2294-4d68-bc11-fbcb3c8b6067 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:55.198380 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d693a9e2-2294-4d68-bc11-fbcb3c8b6067 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:55.199220 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d693a9e2-2294-4d68-bc11-fbcb3c8b6067 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:55.199650 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d693a9e2-2294-4d68-bc11-fbcb3c8b6067 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:55.316594 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.wsgi [None req-92b978a0-29b6-46e2-9f4b-bda96b2f8a2a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] HTTP exception thrown: Cannot 'detach_volume' instance fdd6d861-ef2f-4b74-ba61-41178438391f while it is in vm_state rescued Jun 16 19:03:55.319194 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-92b978a0-29b6-46e2-9f4b-bda96b2f8a2a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Request method failure captured: Jun 16 19:03:55.319194 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: request: DELETE /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f/os-volume_attachments/1c861886-2c72-4497-bec7-d33635c67c25 HTTP/1.1 Jun 16 19:03:55.319194 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Accept: application/json Jun 16 19:03:55.319194 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Accept-Encoding: identity Jun 16 19:03:55.319194 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Connection: close Jun 16 19:03:55.319194 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Content-Length: 0 Jun 16 19:03:55.319194 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Content-Type: application/json Jun 16 19:03:55.319194 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Host: 10.222.0.70 Jun 16 19:03:55.319194 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Openstack-System-Scope: None Jun 16 19:03:55.319194 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: User-Agent: python-urllib3/1.26.9 Jun 16 19:03:55.319194 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Auth-Token: gAAAAABiq32MWlG48BHx8XuuslNdJYyJSrfQU2dcwoyRLL7bw-NKnsaA5lLVdqK2IJiUTQDMxha5Lp11Vgbk2btE0OekI4NBXVXjOTkuuqI_1FxxjoULRHMKHfsoz-Idvd1wKyC2h9kbUWif20GzMiR8FTKv464r3WLs3Okv1rHkW7SJoX6YE7s Jun 16 19:03:55.319194 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Domain-Id: None Jun 16 19:03:55.319194 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Domain-Name: None Jun 16 19:03:55.319194 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Identity-Status: Confirmed Jun 16 19:03:55.319194 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Is-Admin-Project: True Jun 16 19:03:55.319194 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Domain-Id: default Jun 16 19:03:55.319194 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Domain-Name: Default Jun 16 19:03:55.319194 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Id: 83b304be7bd84301b898bb50f4ac7ae4 Jun 16 19:03:55.319194 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-548083212 Jun 16 19:03:55.319194 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Role: member,reader Jun 16 19:03:55.319194 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Roles: member,reader Jun 16 19:03:55.320630 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/83b304be7bd84301b898bb50f4ac7ae4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_83b304be7bd84301b898bb50f4ac7ae4", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/83b304be7bd84301b898bb50f4ac7ae4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/83b304be7bd84301b898bb50f4ac7ae4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 16 19:03:55.320630 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant: tempest-ServerRescueNegativeTestJSON-548083212 Jun 16 19:03:55.320630 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant-Id: 83b304be7bd84301b898bb50f4ac7ae4 Jun 16 19:03:55.320630 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-548083212 Jun 16 19:03:55.320630 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User: tempest-ServerRescueNegativeTestJSON-548083212-project Jun 16 19:03:55.320630 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Domain-Id: default Jun 16 19:03:55.320630 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Domain-Name: Default Jun 16 19:03:55.320630 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Id: 7f703f74c7ff43a291f54103e164ccdf Jun 16 19:03:55.320630 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Name: tempest-ServerRescueNegativeTestJSON-548083212-project Jun 16 19:03:55.320630 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: method: > Jun 16 19:03:55.320630 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: exception: Cannot 'detach_volume' instance fdd6d861-ef2f-4b74-ba61-41178438391f while it is in vm_state rescued Jun 16 19:03:55.321367 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: action_args: {'server_id': 'fdd6d861-ef2f-4b74-ba61-41178438391f', 'id': '1c861886-2c72-4497-bec7-d33635c67c25'} Jun 16 19:03:55.321367 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:03:55.321367 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:03:55.321367 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 16 19:03:55.321367 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 16 19:03:55.321367 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 19:03:55.321367 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 19:03:55.321367 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 16 19:03:55.321367 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 16 19:03:55.321367 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance fdd6d861-ef2f-4b74-ba61-41178438391f in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 16 19:03:55.321367 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:03:55.321367 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:03:55.321367 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:03:55.321367 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:03:55.321367 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:03:55.321367 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:03:55.321367 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:03:55.321367 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:03:55.321367 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:03:55.321367 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:03:55.322664 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 16 19:03:55.322664 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 16 19:03:55.322664 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 16 19:03:55.322664 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 16 19:03:55.322664 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance fdd6d861-ef2f-4b74-ba61-41178438391f while it is in vm_state rescued Jun 16 19:03:55.322664 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:03:55.322664 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:03:55.322664 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:03:55.322664 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:03:55.322664 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:03:55.322664 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:03:55.322664 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:03:55.322664 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:03:55.322664 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance fdd6d861-ef2f-4b74-ba61-41178438391f while it is in vm_state rescued Jun 16 19:03:55.322664 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:03:55.322664 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-92b978a0-29b6-46e2-9f4b-bda96b2f8a2a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Returning 409 to user: Cannot 'detach_volume' instance fdd6d861-ef2f-4b74-ba61-41178438391f while it is in vm_state rescued {{(pid=117852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:03:55.323663 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-92b978a0-29b6-46e2-9f4b-bda96b2f8a2a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "DELETE /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f/os-volume_attachments/1c861886-2c72-4497-bec7-d33635c67c25" status: 409 len: 152 microversion: 2.1 time: 0.144506 Jun 16 19:03:55.323663 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 293/562] 10.222.0.70 () {58 vars in 1415 bytes} [Thu Jun 16 19:03:55 2022] DELETE /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f/os-volume_attachments/1c861886-2c72-4497-bec7-d33635c67c25 => generated 152 bytes in 146 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 16 19:03:55.329452 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-8a296b31-7783-4beb-9fc6-6d9e4a1c80dc tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:03:55.330779 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-8a296b31-7783-4beb-9fc6-6d9e4a1c80dc tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:55.333107 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-d693a9e2-2294-4d68-bc11-fbcb3c8b6067 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb08a57a393d4c8591da42cd5e92aca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c879d7f44189ab76e377c33f5e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:55.336916 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:03:55.337124 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-8a296b31-7783-4beb-9fc6-6d9e4a1c80dc tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:55.337575 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-8a296b31-7783-4beb-9fc6-6d9e4a1c80dc tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:55.338420 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-8a296b31-7783-4beb-9fc6-6d9e4a1c80dc tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:55.339080 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-8a296b31-7783-4beb-9fc6-6d9e4a1c80dc tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:55.342018 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-d693a9e2-2294-4d68-bc11-fbcb3c8b6067 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] 10.222.0.70 "GET /compute/v2.1/servers/1e7cb911-e703-4b7d-98b6-18e49fe78d2e" status: 200 len: 1514 microversion: 2.1 time: 0.154401 Jun 16 19:03:55.342637 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 270/563] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:55 2022] GET /compute/v2.1/servers/1e7cb911-e703-4b7d-98b6-18e49fe78d2e => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:55.408748 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-8a296b31-7783-4beb-9fc6-6d9e4a1c80dc tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "POST /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f/action" status: 202 len: 0 microversion: 2.1 time: 0.082810 Jun 16 19:03:55.409520 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 294/564] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Jun 16 19:03:55 2022] POST /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:03:55.418690 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-b30c62cc-1c37-4926-aef9-8334f33bcd26 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:55.419297 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-b30c62cc-1c37-4926-aef9-8334f33bcd26 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:55.425483 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b30c62cc-1c37-4926-aef9-8334f33bcd26 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:55.425927 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b30c62cc-1c37-4926-aef9-8334f33bcd26 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:55.426699 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b30c62cc-1c37-4926-aef9-8334f33bcd26 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:55.427127 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b30c62cc-1c37-4926-aef9-8334f33bcd26 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:55.561973 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-b30c62cc-1c37-4926-aef9-8334f33bcd26 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:55.571096 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-b30c62cc-1c37-4926-aef9-8334f33bcd26 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f" status: 200 len: 1725 microversion: 2.1 time: 0.157054 Jun 16 19:03:55.571689 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 271/565] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:55 2022] GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:03:56.204274 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-b56f47d3-f620-4cb6-8136-59429fdb49d1 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:56.205003 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-b56f47d3-f620-4cb6-8136-59429fdb49d1 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:56.212649 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-b56f47d3-f620-4cb6-8136-59429fdb49d1 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:56.213099 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-b56f47d3-f620-4cb6-8136-59429fdb49d1 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:56.213857 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-b56f47d3-f620-4cb6-8136-59429fdb49d1 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:56.214293 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-b56f47d3-f620-4cb6-8136-59429fdb49d1 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:56.348091 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-b56f47d3-f620-4cb6-8136-59429fdb49d1 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:56.356393 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-b56f47d3-f620-4cb6-8136-59429fdb49d1 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1676 microversion: 2.1 time: 0.156377 Jun 16 19:03:56.356947 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 295/566] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:56 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:56.360236 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-c6be8f98-2078-4ec3-abda-7bb714a9885e tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:56.360850 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-c6be8f98-2078-4ec3-abda-7bb714a9885e tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] [instance: 1e7cb911-e703-4b7d-98b6-18e49fe78d2e] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:56.368241 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-c6be8f98-2078-4ec3-abda-7bb714a9885e tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:56.368693 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-c6be8f98-2078-4ec3-abda-7bb714a9885e tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:56.369481 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-c6be8f98-2078-4ec3-abda-7bb714a9885e tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:56.369918 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-c6be8f98-2078-4ec3-abda-7bb714a9885e tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:56.501452 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-c6be8f98-2078-4ec3-abda-7bb714a9885e tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb08a57a393d4c8591da42cd5e92aca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c879d7f44189ab76e377c33f5e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:56.510115 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-c6be8f98-2078-4ec3-abda-7bb714a9885e tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] 10.222.0.70 "GET /compute/v2.1/servers/1e7cb911-e703-4b7d-98b6-18e49fe78d2e" status: 200 len: 1514 microversion: 2.1 time: 0.153824 Jun 16 19:03:56.510703 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 272/567] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:56 2022] GET /compute/v2.1/servers/1e7cb911-e703-4b7d-98b6-18e49fe78d2e => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:03:56.588763 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-5830803e-1967-4ee9-8625-eff22d7f137a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:56.589367 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-5830803e-1967-4ee9-8625-eff22d7f137a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:56.595296 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-5830803e-1967-4ee9-8625-eff22d7f137a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:56.595741 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-5830803e-1967-4ee9-8625-eff22d7f137a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:56.596494 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-5830803e-1967-4ee9-8625-eff22d7f137a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:56.596922 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-5830803e-1967-4ee9-8625-eff22d7f137a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:56.731343 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-5830803e-1967-4ee9-8625-eff22d7f137a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:56.739639 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-5830803e-1967-4ee9-8625-eff22d7f137a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f" status: 200 len: 1725 microversion: 2.1 time: 0.154898 Jun 16 19:03:56.740473 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 296/568] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:56 2022] GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:57.373415 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-879ce431-466f-4686-bcb6-603317e24128 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:57.373975 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-879ce431-466f-4686-bcb6-603317e24128 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:57.380426 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-879ce431-466f-4686-bcb6-603317e24128 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:57.381882 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-879ce431-466f-4686-bcb6-603317e24128 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:57.382680 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-879ce431-466f-4686-bcb6-603317e24128 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:57.383119 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-879ce431-466f-4686-bcb6-603317e24128 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:57.517547 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-879ce431-466f-4686-bcb6-603317e24128 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:57.526087 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-879ce431-466f-4686-bcb6-603317e24128 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1676 microversion: 2.1 time: 0.156569 Jun 16 19:03:57.526650 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 273/569] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:57 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:57.527912 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-92c1924c-19b3-4c20-a811-0fe5ddfc5c39 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:57.528552 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-92c1924c-19b3-4c20-a811-0fe5ddfc5c39 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] [instance: 1e7cb911-e703-4b7d-98b6-18e49fe78d2e] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:57.535027 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-92c1924c-19b3-4c20-a811-0fe5ddfc5c39 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:57.535471 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-92c1924c-19b3-4c20-a811-0fe5ddfc5c39 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:57.536223 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-92c1924c-19b3-4c20-a811-0fe5ddfc5c39 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:57.536655 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-92c1924c-19b3-4c20-a811-0fe5ddfc5c39 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:57.664779 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-92c1924c-19b3-4c20-a811-0fe5ddfc5c39 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb08a57a393d4c8591da42cd5e92aca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c879d7f44189ab76e377c33f5e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:57.672073 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-92c1924c-19b3-4c20-a811-0fe5ddfc5c39 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] 10.222.0.70 "GET /compute/v2.1/servers/1e7cb911-e703-4b7d-98b6-18e49fe78d2e" status: 200 len: 1514 microversion: 2.1 time: 0.148232 Jun 16 19:03:57.672621 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 297/570] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:57 2022] GET /compute/v2.1/servers/1e7cb911-e703-4b7d-98b6-18e49fe78d2e => generated 1514 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:57.757797 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-dc907b32-30f6-4511-8948-9f8baf78d6f6 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:57.758401 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-dc907b32-30f6-4511-8948-9f8baf78d6f6 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:57.764387 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-dc907b32-30f6-4511-8948-9f8baf78d6f6 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:57.764837 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-dc907b32-30f6-4511-8948-9f8baf78d6f6 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:57.765587 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-dc907b32-30f6-4511-8948-9f8baf78d6f6 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:57.766017 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-dc907b32-30f6-4511-8948-9f8baf78d6f6 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:57.899260 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-dc907b32-30f6-4511-8948-9f8baf78d6f6 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:57.907341 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-dc907b32-30f6-4511-8948-9f8baf78d6f6 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f" status: 200 len: 1725 microversion: 2.1 time: 0.153333 Jun 16 19:03:57.907896 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 274/571] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:57 2022] GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:03:58.544044 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-8635c03b-0f2d-4b36-8ff8-4f1a869493a7 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:58.544615 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-8635c03b-0f2d-4b36-8ff8-4f1a869493a7 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:58.551241 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-8635c03b-0f2d-4b36-8ff8-4f1a869493a7 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:58.551737 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-8635c03b-0f2d-4b36-8ff8-4f1a869493a7 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:58.552574 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-8635c03b-0f2d-4b36-8ff8-4f1a869493a7 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:58.553094 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-8635c03b-0f2d-4b36-8ff8-4f1a869493a7 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:58.689276 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-3fbe0d67-2cfb-40b7-8067-17118e0a6e01 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:58.689890 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-3fbe0d67-2cfb-40b7-8067-17118e0a6e01 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] [instance: 1e7cb911-e703-4b7d-98b6-18e49fe78d2e] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:58.697818 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-3fbe0d67-2cfb-40b7-8067-17118e0a6e01 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:58.698264 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-3fbe0d67-2cfb-40b7-8067-17118e0a6e01 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:58.699052 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-3fbe0d67-2cfb-40b7-8067-17118e0a6e01 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:58.699483 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-3fbe0d67-2cfb-40b7-8067-17118e0a6e01 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:58.840194 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-3fbe0d67-2cfb-40b7-8067-17118e0a6e01 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb08a57a393d4c8591da42cd5e92aca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c879d7f44189ab76e377c33f5e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:58.851378 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-3fbe0d67-2cfb-40b7-8067-17118e0a6e01 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] 10.222.0.70 "GET /compute/v2.1/servers/1e7cb911-e703-4b7d-98b6-18e49fe78d2e" status: 200 len: 1514 microversion: 2.1 time: 0.165392 Jun 16 19:03:58.852265 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 275/572] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:58 2022] GET /compute/v2.1/servers/1e7cb911-e703-4b7d-98b6-18e49fe78d2e => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:03:58.892574 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-8635c03b-0f2d-4b36-8ff8-4f1a869493a7 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:58.901138 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-8635c03b-0f2d-4b36-8ff8-4f1a869493a7 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1676 microversion: 2.1 time: 0.361089 Jun 16 19:03:58.901704 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 298/573] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:58 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1676 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:03:58.925856 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-38657f87-8bc3-451c-9da1-1122bf59cf3a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:58.926465 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-38657f87-8bc3-451c-9da1-1122bf59cf3a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:58.932759 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-38657f87-8bc3-451c-9da1-1122bf59cf3a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:58.933210 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-38657f87-8bc3-451c-9da1-1122bf59cf3a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:58.933972 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-38657f87-8bc3-451c-9da1-1122bf59cf3a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:58.934403 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-38657f87-8bc3-451c-9da1-1122bf59cf3a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:59.078425 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-38657f87-8bc3-451c-9da1-1122bf59cf3a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:59.087799 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-38657f87-8bc3-451c-9da1-1122bf59cf3a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f" status: 200 len: 1725 microversion: 2.1 time: 0.165607 Jun 16 19:03:59.088406 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 276/574] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:58 2022] GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:03:59.245165 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [req-13ff1667-c4e1-422a-bb5c-d275c221134b req-846b50c3-1515-44a7-9a09-1eef45f8d9dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e7cb911-e703-4b7d-98b6-18e49fe78d2e", "name": "network-vif-deleted", "tag": "96be2083-6edc-4da3-b172-f464c3715da2"}]} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:03:59.263024 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-13ff1667-c4e1-422a-bb5c-d275c221134b req-846b50c3-1515-44a7-9a09-1eef45f8d9dc service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:59.264345 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-13ff1667-c4e1-422a-bb5c-d275c221134b req-846b50c3-1515-44a7-9a09-1eef45f8d9dc service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:59.277711 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.compute.server_external_events [req-13ff1667-c4e1-422a-bb5c-d275c221134b req-846b50c3-1515-44a7-9a09-1eef45f8d9dc service nova] Creating event network-vif-deleted:96be2083-6edc-4da3-b172-f464c3715da2 for instance 1e7cb911-e703-4b7d-98b6-18e49fe78d2e on hv-cinder-84617 Jun 16 19:03:59.283600 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [req-13ff1667-c4e1-422a-bb5c-d275c221134b req-846b50c3-1515-44a7-9a09-1eef45f8d9dc service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042173 Jun 16 19:03:59.284194 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 299/575] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:03:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:03:59.870766 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-c6f883b1-63bd-4fcb-bc1a-326c1927729c tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:59.871392 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-c6f883b1-63bd-4fcb-bc1a-326c1927729c tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] [instance: 1e7cb911-e703-4b7d-98b6-18e49fe78d2e] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:59.877796 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-c6f883b1-63bd-4fcb-bc1a-326c1927729c tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:59.878237 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-c6f883b1-63bd-4fcb-bc1a-326c1927729c tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:59.879015 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-c6f883b1-63bd-4fcb-bc1a-326c1927729c tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:59.879444 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-c6f883b1-63bd-4fcb-bc1a-326c1927729c tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:59.919342 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-3fe38a00-a447-4b2d-bcad-6a49b3d701d4 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:03:59.920154 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-3fe38a00-a447-4b2d-bcad-6a49b3d701d4 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:03:59.926799 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-3fe38a00-a447-4b2d-bcad-6a49b3d701d4 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:59.927256 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-3fe38a00-a447-4b2d-bcad-6a49b3d701d4 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:59.928068 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-3fe38a00-a447-4b2d-bcad-6a49b3d701d4 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:03:59.928511 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-3fe38a00-a447-4b2d-bcad-6a49b3d701d4 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:03:59.942154 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-c6f883b1-63bd-4fcb-bc1a-326c1927729c tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb08a57a393d4c8591da42cd5e92aca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c879d7f44189ab76e377c33f5e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:03:59.951215 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-c6f883b1-63bd-4fcb-bc1a-326c1927729c tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] 10.222.0.70 "GET /compute/v2.1/servers/1e7cb911-e703-4b7d-98b6-18e49fe78d2e" status: 200 len: 1304 microversion: 2.1 time: 0.083802 Jun 16 19:03:59.952045 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 277/576] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:59 2022] GET /compute/v2.1/servers/1e7cb911-e703-4b7d-98b6-18e49fe78d2e => generated 1304 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:00.066914 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-3fe38a00-a447-4b2d-bcad-6a49b3d701d4 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:00.075612 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-3fe38a00-a447-4b2d-bcad-6a49b3d701d4 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1676 microversion: 2.1 time: 0.160938 Jun 16 19:04:00.076192 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 300/577] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:03:59 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:04:00.104504 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-d1799a1d-fe61-4368-9801-ae95cc5ae13d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:00.105135 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-d1799a1d-fe61-4368-9801-ae95cc5ae13d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:00.111248 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d1799a1d-fe61-4368-9801-ae95cc5ae13d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:00.111702 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d1799a1d-fe61-4368-9801-ae95cc5ae13d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:00.112461 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d1799a1d-fe61-4368-9801-ae95cc5ae13d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:00.112895 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d1799a1d-fe61-4368-9801-ae95cc5ae13d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:00.240870 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-d1799a1d-fe61-4368-9801-ae95cc5ae13d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:00.249134 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-d1799a1d-fe61-4368-9801-ae95cc5ae13d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f" status: 200 len: 1725 microversion: 2.1 time: 0.148435 Jun 16 19:04:00.249736 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 278/578] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:00 2022] GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:00.968636 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-8031fd30-aeeb-4953-9e08-186abf860ecd tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:00.969245 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-8031fd30-aeeb-4953-9e08-186abf860ecd tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] [instance: 1e7cb911-e703-4b7d-98b6-18e49fe78d2e] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:00.976458 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-8031fd30-aeeb-4953-9e08-186abf860ecd tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:00.976903 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-8031fd30-aeeb-4953-9e08-186abf860ecd tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:00.977659 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-8031fd30-aeeb-4953-9e08-186abf860ecd tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:00.978090 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-8031fd30-aeeb-4953-9e08-186abf860ecd tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:01.047697 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-8031fd30-aeeb-4953-9e08-186abf860ecd tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb08a57a393d4c8591da42cd5e92aca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c879d7f44189ab76e377c33f5e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:01.056281 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-8031fd30-aeeb-4953-9e08-186abf860ecd tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] 10.222.0.70 "GET /compute/v2.1/servers/1e7cb911-e703-4b7d-98b6-18e49fe78d2e" status: 200 len: 1304 microversion: 2.1 time: 0.091500 Jun 16 19:04:01.056846 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 301/579] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:00 2022] GET /compute/v2.1/servers/1e7cb911-e703-4b7d-98b6-18e49fe78d2e => generated 1304 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:04:01.094522 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-60f1d776-e7dd-435c-b8d9-f6ddb430edc7 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:01.095327 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-60f1d776-e7dd-435c-b8d9-f6ddb430edc7 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:01.103565 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-60f1d776-e7dd-435c-b8d9-f6ddb430edc7 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:01.104105 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-60f1d776-e7dd-435c-b8d9-f6ddb430edc7 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:01.105075 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-60f1d776-e7dd-435c-b8d9-f6ddb430edc7 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:01.105516 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-60f1d776-e7dd-435c-b8d9-f6ddb430edc7 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:01.241176 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-60f1d776-e7dd-435c-b8d9-f6ddb430edc7 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:01.248615 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-60f1d776-e7dd-435c-b8d9-f6ddb430edc7 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1676 microversion: 2.1 time: 0.159333 Jun 16 19:04:01.249178 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 279/580] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:01 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:01.266784 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-a649a01f-b5d8-40d9-9be0-9c901acf7836 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:01.267405 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-a649a01f-b5d8-40d9-9be0-9c901acf7836 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:01.273735 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-a649a01f-b5d8-40d9-9be0-9c901acf7836 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:01.274193 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-a649a01f-b5d8-40d9-9be0-9c901acf7836 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:01.275054 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-a649a01f-b5d8-40d9-9be0-9c901acf7836 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:01.275751 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-a649a01f-b5d8-40d9-9be0-9c901acf7836 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:01.411122 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-a649a01f-b5d8-40d9-9be0-9c901acf7836 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:01.420660 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-a649a01f-b5d8-40d9-9be0-9c901acf7836 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f" status: 200 len: 1725 microversion: 2.1 time: 0.157862 Jun 16 19:04:01.421221 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 302/581] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:01 2022] GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:02.074388 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-f9eb3a84-db90-4351-8e74-2c32f6b8bd3c tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:02.074951 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-f9eb3a84-db90-4351-8e74-2c32f6b8bd3c tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] [instance: 1e7cb911-e703-4b7d-98b6-18e49fe78d2e] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:02.081189 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-f9eb3a84-db90-4351-8e74-2c32f6b8bd3c tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:02.081638 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-f9eb3a84-db90-4351-8e74-2c32f6b8bd3c tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:02.082427 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-f9eb3a84-db90-4351-8e74-2c32f6b8bd3c tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:02.082903 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-f9eb3a84-db90-4351-8e74-2c32f6b8bd3c tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:02.116153 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-f9eb3a84-db90-4351-8e74-2c32f6b8bd3c tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:02.116777 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-f9eb3a84-db90-4351-8e74-2c32f6b8bd3c tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:02.117169 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.objects.instance [None req-f9eb3a84-db90-4351-8e74-2c32f6b8bd3c tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lazy-loading 'fault' on Instance uuid 1e7cb911-e703-4b7d-98b6-18e49fe78d2e {{(pid=117850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:04:02.158331 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-f9eb3a84-db90-4351-8e74-2c32f6b8bd3c tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb08a57a393d4c8591da42cd5e92aca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c879d7f44189ab76e377c33f5e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:02.166397 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-f9eb3a84-db90-4351-8e74-2c32f6b8bd3c tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] 10.222.0.70 "GET /compute/v2.1/servers/1e7cb911-e703-4b7d-98b6-18e49fe78d2e" status: 200 len: 1309 microversion: 2.1 time: 0.096116 Jun 16 19:04:02.166984 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 280/582] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:02 2022] GET /compute/v2.1/servers/1e7cb911-e703-4b7d-98b6-18e49fe78d2e => generated 1309 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:02.265245 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-6dbf2d2a-76ca-42c6-b72c-cc9c1149ebd7 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:02.265862 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-6dbf2d2a-76ca-42c6-b72c-cc9c1149ebd7 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:02.272839 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-6dbf2d2a-76ca-42c6-b72c-cc9c1149ebd7 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:02.273288 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-6dbf2d2a-76ca-42c6-b72c-cc9c1149ebd7 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:02.274046 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-6dbf2d2a-76ca-42c6-b72c-cc9c1149ebd7 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:02.274480 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-6dbf2d2a-76ca-42c6-b72c-cc9c1149ebd7 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:02.407379 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-6dbf2d2a-76ca-42c6-b72c-cc9c1149ebd7 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:02.415218 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-6dbf2d2a-76ca-42c6-b72c-cc9c1149ebd7 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1676 microversion: 2.1 time: 0.153873 Jun 16 19:04:02.415773 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 303/583] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:02 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:02.438834 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-2501a489-39a4-48ab-87db-c93e9ceaa0a5 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:02.439442 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-2501a489-39a4-48ab-87db-c93e9ceaa0a5 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:02.445998 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-2501a489-39a4-48ab-87db-c93e9ceaa0a5 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:02.446440 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-2501a489-39a4-48ab-87db-c93e9ceaa0a5 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:02.447222 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-2501a489-39a4-48ab-87db-c93e9ceaa0a5 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:02.447650 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-2501a489-39a4-48ab-87db-c93e9ceaa0a5 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:02.575266 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-2501a489-39a4-48ab-87db-c93e9ceaa0a5 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:02.583424 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-2501a489-39a4-48ab-87db-c93e9ceaa0a5 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f" status: 200 len: 1731 microversion: 2.1 time: 0.148209 Jun 16 19:04:02.584311 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 281/584] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:02 2022] GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f => generated 1731 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:02.601331 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-7d86dd72-ca63-4eff-86ab-2d0eecfbf18b tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:02.601826 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-7d86dd72-ca63-4eff-86ab-2d0eecfbf18b tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:02.608033 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-7d86dd72-ca63-4eff-86ab-2d0eecfbf18b tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:02.609099 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-7d86dd72-ca63-4eff-86ab-2d0eecfbf18b tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:02.610084 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-7d86dd72-ca63-4eff-86ab-2d0eecfbf18b tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:02.610595 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-7d86dd72-ca63-4eff-86ab-2d0eecfbf18b tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:02.694656 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-7d86dd72-ca63-4eff-86ab-2d0eecfbf18b tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097618 Jun 16 19:04:02.695255 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 304/585] 10.222.0.70 () {58 vars in 1274 bytes} [Thu Jun 16 19:04:02 2022] GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:04:03.183892 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-a5097903-99e1-4e77-a31d-d6a23f48dffc tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:03.184521 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-a5097903-99e1-4e77-a31d-d6a23f48dffc tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] [instance: 1e7cb911-e703-4b7d-98b6-18e49fe78d2e] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:03.190959 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-a5097903-99e1-4e77-a31d-d6a23f48dffc tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:03.191408 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-a5097903-99e1-4e77-a31d-d6a23f48dffc tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:03.192152 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-a5097903-99e1-4e77-a31d-d6a23f48dffc tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:03.192588 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-a5097903-99e1-4e77-a31d-d6a23f48dffc tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:03.207528 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.wsgi [None req-a5097903-99e1-4e77-a31d-d6a23f48dffc tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] HTTP exception thrown: Instance 1e7cb911-e703-4b7d-98b6-18e49fe78d2e could not be found. Jun 16 19:04:03.209240 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-a5097903-99e1-4e77-a31d-d6a23f48dffc tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Request method failure captured: Jun 16 19:04:03.209240 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: request: GET /compute/v2.1/servers/1e7cb911-e703-4b7d-98b6-18e49fe78d2e HTTP/1.1 Jun 16 19:04:03.209240 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Accept: application/json Jun 16 19:04:03.209240 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Accept-Encoding: identity Jun 16 19:04:03.209240 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Connection: close Jun 16 19:04:03.209240 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Content-Length: 0 Jun 16 19:04:03.209240 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Content-Type: application/json Jun 16 19:04:03.209240 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Host: 10.222.0.70 Jun 16 19:04:03.209240 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Openstack-System-Scope: None Jun 16 19:04:03.209240 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: User-Agent: python-urllib3/1.26.9 Jun 16 19:04:03.209240 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Auth-Token: gAAAAABiq35PnckO-HGwf8Hwj__PpZL_PaDZQrek7hhq3DlpaNeYXhhXK2oBdXFPcw-iYNOW3EbSzzAU011CY_00zFk9KcWRnivqTUh1tGKeoQOEOD15lh4NuH6eGAEF8_gRLAAyQioNPvmVvkInjHcA8S0zJeRo9Qya53p79Vx3821l347rBtc Jun 16 19:04:03.209240 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Domain-Id: None Jun 16 19:04:03.209240 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Domain-Name: None Jun 16 19:04:03.209240 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Identity-Status: Confirmed Jun 16 19:04:03.209240 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Is-Admin-Project: True Jun 16 19:04:03.209240 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Domain-Id: default Jun 16 19:04:03.209240 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Domain-Name: Default Jun 16 19:04:03.209240 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Id: ddb2c879d7f44189ab76e377c33f5e35 Jun 16 19:04:03.209240 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Name: tempest-VolumesSnapshotTestJSON-941902203 Jun 16 19:04:03.209240 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Role: member,reader Jun 16 19:04:03.209240 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Roles: member,reader Jun 16 19:04:03.210909 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ddb2c879d7f44189ab76e377c33f5e35"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_ddb2c879d7f44189ab76e377c33f5e35", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/ddb2c879d7f44189ab76e377c33f5e35"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ddb2c879d7f44189ab76e377c33f5e35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 16 19:04:03.210909 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant: tempest-VolumesSnapshotTestJSON-941902203 Jun 16 19:04:03.210909 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant-Id: ddb2c879d7f44189ab76e377c33f5e35 Jun 16 19:04:03.210909 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-941902203 Jun 16 19:04:03.210909 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User: tempest-VolumesSnapshotTestJSON-941902203-project Jun 16 19:04:03.210909 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Domain-Id: default Jun 16 19:04:03.210909 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Domain-Name: Default Jun 16 19:04:03.210909 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Id: fb08a57a393d4c8591da42cd5e92aca9 Jun 16 19:04:03.210909 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Name: tempest-VolumesSnapshotTestJSON-941902203-project Jun 16 19:04:03.210909 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: method: > Jun 16 19:04:03.210909 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: exception: Instance 1e7cb911-e703-4b7d-98b6-18e49fe78d2e could not be found. Jun 16 19:04:03.210909 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: action_args: {'id': '1e7cb911-e703-4b7d-98b6-18e49fe78d2e'} Jun 16 19:04:03.211787 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:04:03.211787 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:04:03.211787 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:04:03.211787 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:04:03.211787 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:04:03.211787 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:04:03.211787 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:04:03.211787 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:04:03.211787 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:04:03.211787 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:04:03.211787 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e7cb911-e703-4b7d-98b6-18e49fe78d2e could not be found. Jun 16 19:04:03.211787 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:04:03.211787 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:04:03.211787 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:04:03.211787 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:04:03.211787 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:04:03.211787 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:04:03.211787 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:04:03.211787 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:04:03.211787 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:04:03.212966 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:04:03.212966 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:04:03.212966 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:04:03.212966 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:04:03.212966 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:04:03.212966 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:04:03.212966 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:04:03.212966 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e7cb911-e703-4b7d-98b6-18e49fe78d2e could not be found. Jun 16 19:04:03.212966 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:04:03.212966 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:04:03.212966 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:04:03.212966 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:04:03.212966 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:04:03.212966 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:04:03.212966 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:04:03.212966 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:04:03.212966 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e7cb911-e703-4b7d-98b6-18e49fe78d2e could not be found. Jun 16 19:04:03.212966 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:04:03.214031 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-a5097903-99e1-4e77-a31d-d6a23f48dffc tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Returning 404 to user: Instance 1e7cb911-e703-4b7d-98b6-18e49fe78d2e could not be found. {{(pid=117850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:04:03.214031 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-a5097903-99e1-4e77-a31d-d6a23f48dffc tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] 10.222.0.70 "GET /compute/v2.1/servers/1e7cb911-e703-4b7d-98b6-18e49fe78d2e" status: 404 len: 111 microversion: 2.1 time: 0.031312 Jun 16 19:04:03.214031 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 282/586] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:03 2022] GET /compute/v2.1/servers/1e7cb911-e703-4b7d-98b6-18e49fe78d2e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:04:03.433828 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-cf9558dd-f219-4075-b28d-01731f500f4b tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:03.434984 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-cf9558dd-f219-4075-b28d-01731f500f4b tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:03.442306 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-cf9558dd-f219-4075-b28d-01731f500f4b tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:03.443693 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-cf9558dd-f219-4075-b28d-01731f500f4b tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:03.444376 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-cf9558dd-f219-4075-b28d-01731f500f4b tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:03.444654 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-cf9558dd-f219-4075-b28d-01731f500f4b tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:03.660884 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-cf9558dd-f219-4075-b28d-01731f500f4b tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:03.669811 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-cf9558dd-f219-4075-b28d-01731f500f4b tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1676 microversion: 2.1 time: 0.241006 Jun 16 19:04:03.674829 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [req-0803f1cb-2bc7-4315-8dc2-34d38db38861 req-a35af6aa-32d2-4a04-930f-1facf4812328 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdd6d861-ef2f-4b74-ba61-41178438391f", "tag": "1ac6c4c7-65ae-4602-b8de-8ddcba59c0e5"}]} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:04:03.681215 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 305/587] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:03 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1676 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:04:03.685764 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-0803f1cb-2bc7-4315-8dc2-34d38db38861 req-a35af6aa-32d2-4a04-930f-1facf4812328 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:03.686365 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-0803f1cb-2bc7-4315-8dc2-34d38db38861 req-a35af6aa-32d2-4a04-930f-1facf4812328 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:03.698815 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.compute.server_external_events [req-0803f1cb-2bc7-4315-8dc2-34d38db38861 req-a35af6aa-32d2-4a04-930f-1facf4812328 service nova] Creating event network-changed:1ac6c4c7-65ae-4602-b8de-8ddcba59c0e5 for instance fdd6d861-ef2f-4b74-ba61-41178438391f on hv-cinder-84617 Jun 16 19:04:03.704639 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [req-0803f1cb-2bc7-4315-8dc2-34d38db38861 req-a35af6aa-32d2-4a04-930f-1facf4812328 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034284 Jun 16 19:04:03.705371 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 283/588] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:04:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:04:04.687385 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-405d91ad-26f5-49ac-9849-a840569e5254 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:04.688004 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-405d91ad-26f5-49ac-9849-a840569e5254 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:04.695392 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-405d91ad-26f5-49ac-9849-a840569e5254 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:04.695841 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-405d91ad-26f5-49ac-9849-a840569e5254 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:04.696610 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-405d91ad-26f5-49ac-9849-a840569e5254 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:04.697045 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-405d91ad-26f5-49ac-9849-a840569e5254 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:04.714849 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:04:04.828288 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-405d91ad-26f5-49ac-9849-a840569e5254 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:04.835935 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-405d91ad-26f5-49ac-9849-a840569e5254 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1676 microversion: 2.1 time: 0.152397 Jun 16 19:04:04.836491 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 306/589] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:04 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:04:05.720079 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [req-640e188e-8cca-43ae-ae4b-bbb972bb6d97 req-208aff02-c8e4-47a6-a5b3-ea1a2978914d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdd6d861-ef2f-4b74-ba61-41178438391f", "tag": "1ac6c4c7-65ae-4602-b8de-8ddcba59c0e5"}]} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:04:05.728711 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-640e188e-8cca-43ae-ae4b-bbb972bb6d97 req-208aff02-c8e4-47a6-a5b3-ea1a2978914d service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:05.729147 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-640e188e-8cca-43ae-ae4b-bbb972bb6d97 req-208aff02-c8e4-47a6-a5b3-ea1a2978914d service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:05.739659 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.compute.server_external_events [req-640e188e-8cca-43ae-ae4b-bbb972bb6d97 req-208aff02-c8e4-47a6-a5b3-ea1a2978914d service nova] Creating event network-changed:1ac6c4c7-65ae-4602-b8de-8ddcba59c0e5 for instance fdd6d861-ef2f-4b74-ba61-41178438391f on hv-cinder-84617 Jun 16 19:04:05.744600 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [req-640e188e-8cca-43ae-ae4b-bbb972bb6d97 req-208aff02-c8e4-47a6-a5b3-ea1a2978914d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029039 Jun 16 19:04:05.745160 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 284/590] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:04:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:04:05.853480 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-5039cc84-6d96-4ab8-a431-2091171c78f2 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:05.854113 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-5039cc84-6d96-4ab8-a431-2091171c78f2 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:05.860737 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-5039cc84-6d96-4ab8-a431-2091171c78f2 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:05.861179 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-5039cc84-6d96-4ab8-a431-2091171c78f2 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:05.861926 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-5039cc84-6d96-4ab8-a431-2091171c78f2 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:05.862354 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-5039cc84-6d96-4ab8-a431-2091171c78f2 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:06.000370 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-5039cc84-6d96-4ab8-a431-2091171c78f2 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:06.007917 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-5039cc84-6d96-4ab8-a431-2091171c78f2 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1676 microversion: 2.1 time: 0.158940 Jun 16 19:04:06.008471 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 307/591] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:05 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:07.028081 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-4a638f94-458c-4970-8b48-29a0757bd7c5 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:07.028746 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-4a638f94-458c-4970-8b48-29a0757bd7c5 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:07.035189 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-4a638f94-458c-4970-8b48-29a0757bd7c5 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:07.035745 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-4a638f94-458c-4970-8b48-29a0757bd7c5 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:07.036679 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-4a638f94-458c-4970-8b48-29a0757bd7c5 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:07.037115 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-4a638f94-458c-4970-8b48-29a0757bd7c5 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:07.183084 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-4a638f94-458c-4970-8b48-29a0757bd7c5 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:07.190718 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-4a638f94-458c-4970-8b48-29a0757bd7c5 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1676 microversion: 2.1 time: 0.167858 Jun 16 19:04:07.191292 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 285/592] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:07 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1676 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:08.208251 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-3cb0eef9-fd0d-42c5-871b-e534b4d4a2bd tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:08.209710 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-3cb0eef9-fd0d-42c5-871b-e534b4d4a2bd tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:08.215838 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-3cb0eef9-fd0d-42c5-871b-e534b4d4a2bd tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:08.216308 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-3cb0eef9-fd0d-42c5-871b-e534b4d4a2bd tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:08.217064 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-3cb0eef9-fd0d-42c5-871b-e534b4d4a2bd tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:08.217499 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-3cb0eef9-fd0d-42c5-871b-e534b4d4a2bd tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:08.356047 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-3cb0eef9-fd0d-42c5-871b-e534b4d4a2bd tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:08.363410 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-3cb0eef9-fd0d-42c5-871b-e534b4d4a2bd tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1676 microversion: 2.1 time: 0.159323 Jun 16 19:04:08.363960 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 308/593] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:08 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:09.384881 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-03592341-0180-47fb-a60e-bd0b056a967b tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:09.385484 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-03592341-0180-47fb-a60e-bd0b056a967b tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:09.392185 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-03592341-0180-47fb-a60e-bd0b056a967b tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:09.392628 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-03592341-0180-47fb-a60e-bd0b056a967b tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:09.393373 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-03592341-0180-47fb-a60e-bd0b056a967b tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:09.393807 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-03592341-0180-47fb-a60e-bd0b056a967b tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:09.522288 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-03592341-0180-47fb-a60e-bd0b056a967b tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:09.530055 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-03592341-0180-47fb-a60e-bd0b056a967b tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1676 microversion: 2.1 time: 0.149568 Jun 16 19:04:09.530637 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 286/594] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:09 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:04:10.546702 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-ecec1bbb-e878-41e2-ae73-49516a65aedb tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:10.547378 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-ecec1bbb-e878-41e2-ae73-49516a65aedb tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:10.554447 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ecec1bbb-e878-41e2-ae73-49516a65aedb tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:10.554944 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ecec1bbb-e878-41e2-ae73-49516a65aedb tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:10.555708 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ecec1bbb-e878-41e2-ae73-49516a65aedb tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:10.556140 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ecec1bbb-e878-41e2-ae73-49516a65aedb tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:10.804235 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-ecec1bbb-e878-41e2-ae73-49516a65aedb tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:10.811867 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-ecec1bbb-e878-41e2-ae73-49516a65aedb tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1676 microversion: 2.1 time: 0.269039 Jun 16 19:04:10.812462 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 309/595] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:10 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1676 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:11.830106 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-04174217-3bad-493a-a8fe-180add6dda00 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:11.831122 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-04174217-3bad-493a-a8fe-180add6dda00 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:11.838746 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-04174217-3bad-493a-a8fe-180add6dda00 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:11.839204 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-04174217-3bad-493a-a8fe-180add6dda00 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:11.839980 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-04174217-3bad-493a-a8fe-180add6dda00 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:11.840419 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-04174217-3bad-493a-a8fe-180add6dda00 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:12.041065 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-04174217-3bad-493a-a8fe-180add6dda00 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:12.048682 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-04174217-3bad-493a-a8fe-180add6dda00 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1676 microversion: 2.1 time: 0.223292 Jun 16 19:04:12.049246 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 287/596] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:11 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1676 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:13.066440 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-271db356-24eb-4bdc-a6f7-f91469bc7056 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:13.067105 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-271db356-24eb-4bdc-a6f7-f91469bc7056 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:13.075038 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-271db356-24eb-4bdc-a6f7-f91469bc7056 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:13.075484 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-271db356-24eb-4bdc-a6f7-f91469bc7056 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:13.076265 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-271db356-24eb-4bdc-a6f7-f91469bc7056 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:13.076692 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-271db356-24eb-4bdc-a6f7-f91469bc7056 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:13.158469 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-fe8bd2f4-4472-4427-a790-eefc95978dbf tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1402223589", "imageRef": "1d993e69-7f01-4fe0-ba52-0eae2fa43ddf", "flavorRef": "452", "networks": [{"uuid": "8c0c065d-4908-43d1-a3e5-02e5697fbcd6"}]}} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:04:13.211275 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.network.neutron [None req-fe8bd2f4-4472-4427-a790-eefc95978dbf tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] validate_networks() for [('8c0c065d-4908-43d1-a3e5-02e5697fbcd6', None, None, None, None, None)] {{(pid=117850) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:04:13.213240 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-271db356-24eb-4bdc-a6f7-f91469bc7056 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:13.220881 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-271db356-24eb-4bdc-a6f7-f91469bc7056 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1653 microversion: 2.1 time: 0.158747 Jun 16 19:04:13.221449 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 310/597] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:13 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1653 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:13.237063 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-53d40495-b7ae-4ac7-9bad-f9b4c161a6ea tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:04:13.243245 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-53d40495-b7ae-4ac7-9bad-f9b4c161a6ea tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:13.243699 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-53d40495-b7ae-4ac7-9bad-f9b4c161a6ea tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:13.266428 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-53d40495-b7ae-4ac7-9bad-f9b4c161a6ea tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Going to try to start instance {{(pid=117852) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 16 19:04:13.311237 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-53d40495-b7ae-4ac7-9bad-f9b4c161a6ea tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "POST /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee/action" status: 202 len: 0 microversion: 2.1 time: 0.077717 Jun 16 19:04:13.312247 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 311/598] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Jun 16 19:04:13 2022] POST /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 19:04:13.321085 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-ee39cc20-b990-49ef-bf91-2ad7a52d68df tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:13.321892 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-ee39cc20-b990-49ef-bf91-2ad7a52d68df tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:13.328674 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ee39cc20-b990-49ef-bf91-2ad7a52d68df tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:13.329387 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ee39cc20-b990-49ef-bf91-2ad7a52d68df tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:13.330190 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ee39cc20-b990-49ef-bf91-2ad7a52d68df tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:13.330656 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ee39cc20-b990-49ef-bf91-2ad7a52d68df tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:13.492604 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-ee39cc20-b990-49ef-bf91-2ad7a52d68df tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:13.500662 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-ee39cc20-b990-49ef-bf91-2ad7a52d68df tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1662 microversion: 2.1 time: 0.184585 Jun 16 19:04:13.501383 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 312/599] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:13 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1662 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:04:13.608362 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-fe8bd2f4-4472-4427-a790-eefc95978dbf tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Flavor limits 0:0:0 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:04:13.608790 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-fe8bd2f4-4472-4427-a790-eefc95978dbf tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Image limits 0:0:0 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:04:13.609272 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-fe8bd2f4-4472-4427-a790-eefc95978dbf tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Flavor pref 0:0:0 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:04:13.609684 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-fe8bd2f4-4472-4427-a790-eefc95978dbf tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Image pref 0:0:0 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:04:13.610098 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-fe8bd2f4-4472-4427-a790-eefc95978dbf tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:04:13.619115 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-fe8bd2f4-4472-4427-a790-eefc95978dbf tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:13.619567 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-fe8bd2f4-4472-4427-a790-eefc95978dbf tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:13.620397 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-fe8bd2f4-4472-4427-a790-eefc95978dbf tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:13.620839 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-fe8bd2f4-4472-4427-a790-eefc95978dbf tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:13.637745 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.quota [None req-fe8bd2f4-4472-4427-a790-eefc95978dbf tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Getting quotas for project ddb2c879d7f44189ab76e377c33f5e35. Resources: {'cores', 'ram', 'instances'} {{(pid=117850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:04:13.641775 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.quota [None req-fe8bd2f4-4472-4427-a790-eefc95978dbf tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Getting quotas for user fb08a57a393d4c8591da42cd5e92aca9 and project ddb2c879d7f44189ab76e377c33f5e35. Resources: {'cores', 'ram', 'instances'} {{(pid=117850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:04:13.653660 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-fe8bd2f4-4472-4427-a790-eefc95978dbf tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Going to run 1 instances... {{(pid=117850) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:04:13.655881 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-fe8bd2f4-4472-4427-a790-eefc95978dbf tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] [instance: c771affd-c89b-412f-8ece-422ececa188a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1d993e69-7f01-4fe0-ba52-0eae2fa43ddf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:04:13.700726 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-fe8bd2f4-4472-4427-a790-eefc95978dbf tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.545983 Jun 16 19:04:13.706112 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 288/600] 10.222.0.70 () {60 vars in 1146 bytes} [Thu Jun 16 19:04:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 548 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 19:04:13.712655 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-c935f5ff-dc62-43e7-914f-0dea22ae6cd5 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:13.713310 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-c935f5ff-dc62-43e7-914f-0dea22ae6cd5 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] [instance: c771affd-c89b-412f-8ece-422ececa188a] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:13.772304 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-c935f5ff-dc62-43e7-914f-0dea22ae6cd5 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb08a57a393d4c8591da42cd5e92aca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c879d7f44189ab76e377c33f5e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:13.779249 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-c935f5ff-dc62-43e7-914f-0dea22ae6cd5 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] 10.222.0.70 "GET /compute/v2.1/servers/c771affd-c89b-412f-8ece-422ececa188a" status: 200 len: 1219 microversion: 2.1 time: 0.071683 Jun 16 19:04:13.779978 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 313/601] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:13 2022] GET /compute/v2.1/servers/c771affd-c89b-412f-8ece-422ececa188a => generated 1219 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:14.519350 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-6ea79a8d-4c8d-4d11-b266-46caaa8b0a8b tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:14.519969 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-6ea79a8d-4c8d-4d11-b266-46caaa8b0a8b tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:14.529288 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-6ea79a8d-4c8d-4d11-b266-46caaa8b0a8b tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:14.529741 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-6ea79a8d-4c8d-4d11-b266-46caaa8b0a8b tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:14.530521 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-6ea79a8d-4c8d-4d11-b266-46caaa8b0a8b tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:14.530983 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-6ea79a8d-4c8d-4d11-b266-46caaa8b0a8b tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:14.661474 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-6ea79a8d-4c8d-4d11-b266-46caaa8b0a8b tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:14.665030 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_cell1:SELECT=100 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:04:14.670162 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-6ea79a8d-4c8d-4d11-b266-46caaa8b0a8b tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1662 microversion: 2.1 time: 0.155256 Jun 16 19:04:14.670752 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 289/602] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:14 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1662 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:14.796538 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-7ce507a2-6756-4880-8bfb-5012d528938f tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:14.797113 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-7ce507a2-6756-4880-8bfb-5012d528938f tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] [instance: c771affd-c89b-412f-8ece-422ececa188a] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:14.805787 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-7ce507a2-6756-4880-8bfb-5012d528938f tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:14.806243 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-7ce507a2-6756-4880-8bfb-5012d528938f tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:14.807158 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-7ce507a2-6756-4880-8bfb-5012d528938f tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:14.807599 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-7ce507a2-6756-4880-8bfb-5012d528938f tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:14.896572 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-7ce507a2-6756-4880-8bfb-5012d528938f tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb08a57a393d4c8591da42cd5e92aca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c879d7f44189ab76e377c33f5e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:14.904778 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-7ce507a2-6756-4880-8bfb-5012d528938f tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] 10.222.0.70 "GET /compute/v2.1/servers/c771affd-c89b-412f-8ece-422ececa188a" status: 200 len: 1279 microversion: 2.1 time: 0.112350 Jun 16 19:04:14.905974 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 314/603] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:14 2022] GET /compute/v2.1/servers/c771affd-c89b-412f-8ece-422ececa188a => generated 1279 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:15.687480 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-259cad94-6864-4767-a041-15b1b6dafb56 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:15.688024 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-259cad94-6864-4767-a041-15b1b6dafb56 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:15.695006 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-259cad94-6864-4767-a041-15b1b6dafb56 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:15.695454 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-259cad94-6864-4767-a041-15b1b6dafb56 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:15.696212 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-259cad94-6864-4767-a041-15b1b6dafb56 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:15.696643 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-259cad94-6864-4767-a041-15b1b6dafb56 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:15.829598 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-259cad94-6864-4767-a041-15b1b6dafb56 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:15.837619 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-259cad94-6864-4767-a041-15b1b6dafb56 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1666 microversion: 2.1 time: 0.154092 Jun 16 19:04:15.838170 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 290/604] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:15 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1666 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:15.921847 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-951c042a-aa48-4c01-a0d9-f7a803bfd158 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:15.922491 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-951c042a-aa48-4c01-a0d9-f7a803bfd158 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] [instance: c771affd-c89b-412f-8ece-422ececa188a] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:15.929018 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-951c042a-aa48-4c01-a0d9-f7a803bfd158 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:15.929485 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-951c042a-aa48-4c01-a0d9-f7a803bfd158 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:15.930238 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-951c042a-aa48-4c01-a0d9-f7a803bfd158 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:15.930692 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-951c042a-aa48-4c01-a0d9-f7a803bfd158 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:16.123678 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-951c042a-aa48-4c01-a0d9-f7a803bfd158 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb08a57a393d4c8591da42cd5e92aca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c879d7f44189ab76e377c33f5e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:16.131880 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-951c042a-aa48-4c01-a0d9-f7a803bfd158 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] 10.222.0.70 "GET /compute/v2.1/servers/c771affd-c89b-412f-8ece-422ececa188a" status: 200 len: 1319 microversion: 2.1 time: 0.213812 Jun 16 19:04:16.132466 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 315/605] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:15 2022] GET /compute/v2.1/servers/c771affd-c89b-412f-8ece-422ececa188a => generated 1319 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:16.665892 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [req-e84a8061-e4d2-4394-a3c5-c872e43aefc9 req-e6807377-85f8-4136-8de1-46d3e798ff09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c771affd-c89b-412f-8ece-422ececa188a", "tag": "eec4caa0-3777-4a01-a5e8-4be5c8c1f8c9"}]} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:04:16.676429 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-e84a8061-e4d2-4394-a3c5-c872e43aefc9 req-e6807377-85f8-4136-8de1-46d3e798ff09 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:16.676969 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-e84a8061-e4d2-4394-a3c5-c872e43aefc9 req-e6807377-85f8-4136-8de1-46d3e798ff09 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:16.689665 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.compute.server_external_events [req-e84a8061-e4d2-4394-a3c5-c872e43aefc9 req-e6807377-85f8-4136-8de1-46d3e798ff09 service nova] Creating event network-changed:eec4caa0-3777-4a01-a5e8-4be5c8c1f8c9 for instance c771affd-c89b-412f-8ece-422ececa188a on hv-cinder-84617 Jun 16 19:04:16.695536 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [req-e84a8061-e4d2-4394-a3c5-c872e43aefc9 req-e6807377-85f8-4136-8de1-46d3e798ff09 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034965 Jun 16 19:04:16.696141 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 291/606] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:04:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:04:17.148961 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-aae6a8ac-5875-44c9-85b8-61177e4b50b6 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:17.149615 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-aae6a8ac-5875-44c9-85b8-61177e4b50b6 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] [instance: c771affd-c89b-412f-8ece-422ececa188a] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:17.156562 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-aae6a8ac-5875-44c9-85b8-61177e4b50b6 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:17.157007 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-aae6a8ac-5875-44c9-85b8-61177e4b50b6 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:17.157759 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-aae6a8ac-5875-44c9-85b8-61177e4b50b6 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:17.158192 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-aae6a8ac-5875-44c9-85b8-61177e4b50b6 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:17.305636 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-aae6a8ac-5875-44c9-85b8-61177e4b50b6 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb08a57a393d4c8591da42cd5e92aca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c879d7f44189ab76e377c33f5e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:17.313254 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-aae6a8ac-5875-44c9-85b8-61177e4b50b6 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] 10.222.0.70 "GET /compute/v2.1/servers/c771affd-c89b-412f-8ece-422ececa188a" status: 200 len: 1319 microversion: 2.1 time: 0.168801 Jun 16 19:04:17.313808 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 316/607] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:17 2022] GET /compute/v2.1/servers/c771affd-c89b-412f-8ece-422ececa188a => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:17.822892 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-439c36b5-9980-43a6-b321-10b915682e9e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:17.823474 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-439c36b5-9980-43a6-b321-10b915682e9e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:17.829798 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-439c36b5-9980-43a6-b321-10b915682e9e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:17.830291 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-439c36b5-9980-43a6-b321-10b915682e9e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:17.831094 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-439c36b5-9980-43a6-b321-10b915682e9e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:17.831537 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-439c36b5-9980-43a6-b321-10b915682e9e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:17.861211 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-439c36b5-9980-43a6-b321-10b915682e9e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4/os-volume_attachments/d2b007ef-9605-43d7-88d1-91d3fd787015" status: 200 len: 194 microversion: 2.20 time: 0.043495 Jun 16 19:04:17.861785 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 292/608] 10.222.0.70 () {60 vars in 1453 bytes} [Thu Jun 16 19:04:17 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4/os-volume_attachments/d2b007ef-9605-43d7-88d1-91d3fd787015 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 19:04:17.925508 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-703118cd-ae84-4762-8958-a2974441e32e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:17.926015 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-703118cd-ae84-4762-8958-a2974441e32e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:17.932829 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-703118cd-ae84-4762-8958-a2974441e32e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:17.933275 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-703118cd-ae84-4762-8958-a2974441e32e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:17.934030 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-703118cd-ae84-4762-8958-a2974441e32e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:17.934466 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-703118cd-ae84-4762-8958-a2974441e32e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:18.015520 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.objects.instance [None req-703118cd-ae84-4762-8958-a2974441e32e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lazy-loading 'services' on Instance uuid 1c077a29-12e0-48af-a8b6-43d0b5a79bf4 {{(pid=117852) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:04:18.130943 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-703118cd-ae84-4762-8958-a2974441e32e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "DELETE /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4/os-volume_attachments/d2b007ef-9605-43d7-88d1-91d3fd787015" status: 202 len: 0 microversion: 2.20 time: 0.208680 Jun 16 19:04:18.131536 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 317/609] 10.222.0.70 () {60 vars in 1456 bytes} [Thu Jun 16 19:04:17 2022] DELETE /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4/os-volume_attachments/d2b007ef-9605-43d7-88d1-91d3fd787015 => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:04:18.140010 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-0a170493-3907-430d-a5a1-1c9ae1f39428 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:18.140959 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-0a170493-3907-430d-a5a1-1c9ae1f39428 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:18.147659 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0a170493-3907-430d-a5a1-1c9ae1f39428 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:18.148128 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0a170493-3907-430d-a5a1-1c9ae1f39428 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:18.148926 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0a170493-3907-430d-a5a1-1c9ae1f39428 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:18.149367 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0a170493-3907-430d-a5a1-1c9ae1f39428 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:18.179881 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-0a170493-3907-430d-a5a1-1c9ae1f39428 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043807 Jun 16 19:04:18.180448 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 293/610] 10.222.0.70 () {60 vars in 1342 bytes} [Thu Jun 16 19:04:18 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 19:04:18.332090 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-e6a6a53d-e9c4-4156-b26d-553f28f0d805 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:18.332710 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-e6a6a53d-e9c4-4156-b26d-553f28f0d805 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] [instance: c771affd-c89b-412f-8ece-422ececa188a] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:18.339973 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-e6a6a53d-e9c4-4156-b26d-553f28f0d805 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:18.340424 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-e6a6a53d-e9c4-4156-b26d-553f28f0d805 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:18.341184 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-e6a6a53d-e9c4-4156-b26d-553f28f0d805 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:18.341616 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-e6a6a53d-e9c4-4156-b26d-553f28f0d805 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:18.478019 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-e6a6a53d-e9c4-4156-b26d-553f28f0d805 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb08a57a393d4c8591da42cd5e92aca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c879d7f44189ab76e377c33f5e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:18.486116 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-e6a6a53d-e9c4-4156-b26d-553f28f0d805 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] 10.222.0.70 "GET /compute/v2.1/servers/c771affd-c89b-412f-8ece-422ececa188a" status: 200 len: 1319 microversion: 2.1 time: 0.158728 Jun 16 19:04:18.487733 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 318/611] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:18 2022] GET /compute/v2.1/servers/c771affd-c89b-412f-8ece-422ececa188a => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:19.191849 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-a6b3765a-35f2-4900-9938-8f5feae67714 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:19.193695 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-a6b3765a-35f2-4900-9938-8f5feae67714 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:19.200264 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-a6b3765a-35f2-4900-9938-8f5feae67714 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:19.200705 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-a6b3765a-35f2-4900-9938-8f5feae67714 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:19.201480 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-a6b3765a-35f2-4900-9938-8f5feae67714 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:19.201910 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-a6b3765a-35f2-4900-9938-8f5feae67714 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:19.233606 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-a6b3765a-35f2-4900-9938-8f5feae67714 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045710 Jun 16 19:04:19.234441 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 294/612] 10.222.0.70 () {60 vars in 1342 bytes} [Thu Jun 16 19:04:19 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 19:04:19.503720 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-3a71d958-5039-48e7-8112-a982805684a4 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:19.504463 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-3a71d958-5039-48e7-8112-a982805684a4 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] [instance: c771affd-c89b-412f-8ece-422ececa188a] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:19.513541 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-3a71d958-5039-48e7-8112-a982805684a4 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:19.514046 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-3a71d958-5039-48e7-8112-a982805684a4 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:19.514907 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-3a71d958-5039-48e7-8112-a982805684a4 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:19.515471 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-3a71d958-5039-48e7-8112-a982805684a4 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:19.650320 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-3a71d958-5039-48e7-8112-a982805684a4 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb08a57a393d4c8591da42cd5e92aca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c879d7f44189ab76e377c33f5e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:19.657645 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-3a71d958-5039-48e7-8112-a982805684a4 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] 10.222.0.70 "GET /compute/v2.1/servers/c771affd-c89b-412f-8ece-422ececa188a" status: 200 len: 1319 microversion: 2.1 time: 0.157838 Jun 16 19:04:19.658209 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 319/613] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:19 2022] GET /compute/v2.1/servers/c771affd-c89b-412f-8ece-422ececa188a => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:04:20.245544 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-4fb7e19b-0c5a-4239-84ed-32686f38f69e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:20.246522 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-4fb7e19b-0c5a-4239-84ed-32686f38f69e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:20.248687 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:04:20.253814 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-4fb7e19b-0c5a-4239-84ed-32686f38f69e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:20.254256 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-4fb7e19b-0c5a-4239-84ed-32686f38f69e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:20.255049 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-4fb7e19b-0c5a-4239-84ed-32686f38f69e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:20.255635 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-4fb7e19b-0c5a-4239-84ed-32686f38f69e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:20.285159 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-4fb7e19b-0c5a-4239-84ed-32686f38f69e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043667 Jun 16 19:04:20.285712 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 295/614] 10.222.0.70 () {60 vars in 1342 bytes} [Thu Jun 16 19:04:20 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:20.343518 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-f5b1fd34-66a1-453e-8e8a-7d896e70e413 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:20.344021 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-f5b1fd34-66a1-453e-8e8a-7d896e70e413 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:20.346083 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:04:20.353256 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f5b1fd34-66a1-453e-8e8a-7d896e70e413 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:20.353738 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f5b1fd34-66a1-453e-8e8a-7d896e70e413 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:20.354506 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f5b1fd34-66a1-453e-8e8a-7d896e70e413 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:20.355040 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f5b1fd34-66a1-453e-8e8a-7d896e70e413 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:20.380911 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-f5b1fd34-66a1-453e-8e8a-7d896e70e413 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Going to try to terminate instance {{(pid=117852) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:04:20.431133 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:04:20.463512 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-f5b1fd34-66a1-453e-8e8a-7d896e70e413 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "DELETE /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 204 len: 0 microversion: 2.20 time: 0.122900 Jun 16 19:04:20.464548 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 320/615] 10.222.0.70 () {60 vars in 1279 bytes} [Thu Jun 16 19:04:20 2022] DELETE /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 19:04:20.472746 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-5376ac89-d010-4255-b1a5-07486276c4bc tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:20.473355 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-5376ac89-d010-4255-b1a5-07486276c4bc tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:20.479636 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-5376ac89-d010-4255-b1a5-07486276c4bc tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:20.480109 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-5376ac89-d010-4255-b1a5-07486276c4bc tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:20.481192 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-5376ac89-d010-4255-b1a5-07486276c4bc tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:20.481626 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-5376ac89-d010-4255-b1a5-07486276c4bc tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:20.617577 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-5376ac89-d010-4255-b1a5-07486276c4bc tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:20.625509 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-5376ac89-d010-4255-b1a5-07486276c4bc tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:20.627067 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-5376ac89-d010-4255-b1a5-07486276c4bc tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:20.628221 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-5376ac89-d010-4255-b1a5-07486276c4bc tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1723 microversion: 2.20 time: 0.159344 Jun 16 19:04:20.628777 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 296/616] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:04:20 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:04:20.675177 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-0fe4da22-b105-41cf-8065-895915a3f1e7 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:20.675875 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-0fe4da22-b105-41cf-8065-895915a3f1e7 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] [instance: c771affd-c89b-412f-8ece-422ececa188a] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:20.682922 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-0fe4da22-b105-41cf-8065-895915a3f1e7 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:20.683369 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-0fe4da22-b105-41cf-8065-895915a3f1e7 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:20.684152 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-0fe4da22-b105-41cf-8065-895915a3f1e7 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:20.684587 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-0fe4da22-b105-41cf-8065-895915a3f1e7 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:20.703356 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-31bf3a4a-33ae-4493-a1df-0a9e8a2b16ca tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:04:20.703896 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-31bf3a4a-33ae-4493-a1df-0a9e8a2b16ca tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] [instance: c4277200-c999-4c53-85de-b2a8b120cd6d] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:20.710198 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-31bf3a4a-33ae-4493-a1df-0a9e8a2b16ca tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:20.710717 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-31bf3a4a-33ae-4493-a1df-0a9e8a2b16ca tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:20.711557 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-31bf3a4a-33ae-4493-a1df-0a9e8a2b16ca tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:20.712001 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-31bf3a4a-33ae-4493-a1df-0a9e8a2b16ca tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:20.736001 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.objects.instance [None req-31bf3a4a-33ae-4493-a1df-0a9e8a2b16ca tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lazy-loading 'flavor' on Instance uuid c4277200-c999-4c53-85de-b2a8b120cd6d {{(pid=117850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:04:20.814929 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-31bf3a4a-33ae-4493-a1df-0a9e8a2b16ca tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] 10.222.0.70 "POST /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d/action" status: 202 len: 0 microversion: 2.1 time: 0.115319 Jun 16 19:04:20.815433 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 297/617] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Jun 16 19:04:20 2022] POST /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 19:04:20.824167 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-acc7c0d7-c96f-4443-9998-73c94d514e74 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:20.824856 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-acc7c0d7-c96f-4443-9998-73c94d514e74 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] [instance: c4277200-c999-4c53-85de-b2a8b120cd6d] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:20.828744 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-0fe4da22-b105-41cf-8065-895915a3f1e7 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb08a57a393d4c8591da42cd5e92aca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c879d7f44189ab76e377c33f5e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:20.831040 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-acc7c0d7-c96f-4443-9998-73c94d514e74 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:20.831466 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-acc7c0d7-c96f-4443-9998-73c94d514e74 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:20.832216 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-acc7c0d7-c96f-4443-9998-73c94d514e74 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:20.832643 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-acc7c0d7-c96f-4443-9998-73c94d514e74 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:20.836283 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-0fe4da22-b105-41cf-8065-895915a3f1e7 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] 10.222.0.70 "GET /compute/v2.1/servers/c771affd-c89b-412f-8ece-422ececa188a" status: 200 len: 1319 microversion: 2.1 time: 0.165330 Jun 16 19:04:20.836864 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 321/618] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:20 2022] GET /compute/v2.1/servers/c771affd-c89b-412f-8ece-422ececa188a => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:20.969770 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-acc7c0d7-c96f-4443-9998-73c94d514e74 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27db09b804fa426a83f103cf5dd116a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629634dc3dc54893b68cb9c9dc08505d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:20.978424 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-acc7c0d7-c96f-4443-9998-73c94d514e74 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] 10.222.0.70 "GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d" status: 200 len: 1567 microversion: 2.1 time: 0.158260 Jun 16 19:04:20.979022 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 298/619] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:20 2022] GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:04:21.647066 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-6f632599-75d3-4335-ba41-72d0530e584f tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:21.647672 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-6f632599-75d3-4335-ba41-72d0530e584f tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:21.654395 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-6f632599-75d3-4335-ba41-72d0530e584f tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:21.654880 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-6f632599-75d3-4335-ba41-72d0530e584f tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:21.655646 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-6f632599-75d3-4335-ba41-72d0530e584f tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:21.656114 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-6f632599-75d3-4335-ba41-72d0530e584f tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:21.784543 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-6f632599-75d3-4335-ba41-72d0530e584f tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:21.792952 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-6f632599-75d3-4335-ba41-72d0530e584f tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:21.794462 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-6f632599-75d3-4335-ba41-72d0530e584f tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:21.795655 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-6f632599-75d3-4335-ba41-72d0530e584f tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1723 microversion: 2.20 time: 0.153310 Jun 16 19:04:21.796212 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 322/620] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:04:21 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:04:21.853670 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-8044a67d-4261-4c09-93e3-b57a519b5fdd tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:21.854507 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-8044a67d-4261-4c09-93e3-b57a519b5fdd tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] [instance: c771affd-c89b-412f-8ece-422ececa188a] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:21.861937 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-8044a67d-4261-4c09-93e3-b57a519b5fdd tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:21.862396 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-8044a67d-4261-4c09-93e3-b57a519b5fdd tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:21.863199 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-8044a67d-4261-4c09-93e3-b57a519b5fdd tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:21.863636 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-8044a67d-4261-4c09-93e3-b57a519b5fdd tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:21.975774 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [req-9360dc2e-3725-4b1c-8834-20cc1dbc5e6a req-6c79ff1f-fbdc-4d21-8576-dc946adf8f7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c771affd-c89b-412f-8ece-422ececa188a", "name": "network-vif-plugged", "status": "completed", "tag": "eec4caa0-3777-4a01-a5e8-4be5c8c1f8c9"}]} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:04:21.987217 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-9360dc2e-3725-4b1c-8834-20cc1dbc5e6a req-6c79ff1f-fbdc-4d21-8576-dc946adf8f7e service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:21.987217 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-9360dc2e-3725-4b1c-8834-20cc1dbc5e6a req-6c79ff1f-fbdc-4d21-8576-dc946adf8f7e service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:22.000456 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.compute.server_external_events [req-9360dc2e-3725-4b1c-8834-20cc1dbc5e6a req-6c79ff1f-fbdc-4d21-8576-dc946adf8f7e service nova] Creating event network-vif-plugged:eec4caa0-3777-4a01-a5e8-4be5c8c1f8c9 for instance c771affd-c89b-412f-8ece-422ececa188a on hv-cinder-84617 Jun 16 19:04:22.005764 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-8044a67d-4261-4c09-93e3-b57a519b5fdd tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb08a57a393d4c8591da42cd5e92aca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c879d7f44189ab76e377c33f5e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:22.007133 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [req-9360dc2e-3725-4b1c-8834-20cc1dbc5e6a req-6c79ff1f-fbdc-4d21-8576-dc946adf8f7e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035081 Jun 16 19:04:22.008314 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 323/621] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:04:22.013837 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-1068e306-a0df-4f03-8fb5-64f57696676d tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:22.014126 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-8044a67d-4261-4c09-93e3-b57a519b5fdd tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] 10.222.0.70 "GET /compute/v2.1/servers/c771affd-c89b-412f-8ece-422ececa188a" status: 200 len: 1319 microversion: 2.1 time: 0.164315 Jun 16 19:04:22.014351 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-1068e306-a0df-4f03-8fb5-64f57696676d tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] [instance: c4277200-c999-4c53-85de-b2a8b120cd6d] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:22.021496 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-1068e306-a0df-4f03-8fb5-64f57696676d tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:22.021863 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-1068e306-a0df-4f03-8fb5-64f57696676d tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:22.022661 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-1068e306-a0df-4f03-8fb5-64f57696676d tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:22.023211 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-1068e306-a0df-4f03-8fb5-64f57696676d tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:22.023528 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 299/622] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:21 2022] GET /compute/v2.1/servers/c771affd-c89b-412f-8ece-422ececa188a => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:22.163264 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-1068e306-a0df-4f03-8fb5-64f57696676d tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27db09b804fa426a83f103cf5dd116a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629634dc3dc54893b68cb9c9dc08505d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:22.170839 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-1068e306-a0df-4f03-8fb5-64f57696676d tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] 10.222.0.70 "GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d" status: 200 len: 1567 microversion: 2.1 time: 0.161726 Jun 16 19:04:22.171410 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 324/623] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:22 2022] GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:22.815146 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-06327610-1eaa-4f87-8339-305d7cf7e8c7 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:22.815797 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-06327610-1eaa-4f87-8339-305d7cf7e8c7 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:22.823263 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-06327610-1eaa-4f87-8339-305d7cf7e8c7 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:22.823721 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-06327610-1eaa-4f87-8339-305d7cf7e8c7 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:22.824506 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-06327610-1eaa-4f87-8339-305d7cf7e8c7 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:22.824979 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-06327610-1eaa-4f87-8339-305d7cf7e8c7 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:22.954229 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-06327610-1eaa-4f87-8339-305d7cf7e8c7 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:22.963650 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-06327610-1eaa-4f87-8339-305d7cf7e8c7 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:22.965146 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-06327610-1eaa-4f87-8339-305d7cf7e8c7 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:22.966334 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-06327610-1eaa-4f87-8339-305d7cf7e8c7 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1723 microversion: 2.20 time: 0.155186 Jun 16 19:04:22.966916 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 300/624] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:04:22 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:04:23.030944 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-48957821-9718-4763-a6f6-77e87f22084e tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:23.031792 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-48957821-9718-4763-a6f6-77e87f22084e tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] [instance: c771affd-c89b-412f-8ece-422ececa188a] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:23.039897 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-48957821-9718-4763-a6f6-77e87f22084e tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:23.040682 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-48957821-9718-4763-a6f6-77e87f22084e tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:23.042036 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-48957821-9718-4763-a6f6-77e87f22084e tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:23.042617 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-48957821-9718-4763-a6f6-77e87f22084e tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:23.188532 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-a3afcc49-a884-4f86-9e52-505becea3bf6 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:23.189298 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-a3afcc49-a884-4f86-9e52-505becea3bf6 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] [instance: c4277200-c999-4c53-85de-b2a8b120cd6d] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:23.196169 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-a3afcc49-a884-4f86-9e52-505becea3bf6 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:23.196618 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-a3afcc49-a884-4f86-9e52-505becea3bf6 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:23.197385 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-a3afcc49-a884-4f86-9e52-505becea3bf6 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:23.197819 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-a3afcc49-a884-4f86-9e52-505becea3bf6 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:23.253189 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-48957821-9718-4763-a6f6-77e87f22084e tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb08a57a393d4c8591da42cd5e92aca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c879d7f44189ab76e377c33f5e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:23.261101 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-48957821-9718-4763-a6f6-77e87f22084e tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] 10.222.0.70 "GET /compute/v2.1/servers/c771affd-c89b-412f-8ece-422ececa188a" status: 200 len: 1319 microversion: 2.1 time: 0.233985 Jun 16 19:04:23.268336 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 325/625] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:23 2022] GET /compute/v2.1/servers/c771affd-c89b-412f-8ece-422ececa188a => generated 1319 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:23.358599 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-a3afcc49-a884-4f86-9e52-505becea3bf6 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27db09b804fa426a83f103cf5dd116a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629634dc3dc54893b68cb9c9dc08505d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:23.366880 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-a3afcc49-a884-4f86-9e52-505becea3bf6 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] 10.222.0.70 "GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d" status: 200 len: 1567 microversion: 2.1 time: 0.182058 Jun 16 19:04:23.367469 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 301/626] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:23 2022] GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d => generated 1567 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:04:23.984449 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-99c14348-a6d4-49ad-9feb-dbbca8c11813 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:23.985180 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-99c14348-a6d4-49ad-9feb-dbbca8c11813 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:23.987296 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_cell0:SELECT=2 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:04:23.993667 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-99c14348-a6d4-49ad-9feb-dbbca8c11813 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:23.994118 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-99c14348-a6d4-49ad-9feb-dbbca8c11813 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:23.994939 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-99c14348-a6d4-49ad-9feb-dbbca8c11813 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:23.995375 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-99c14348-a6d4-49ad-9feb-dbbca8c11813 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:24.211487 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-99c14348-a6d4-49ad-9feb-dbbca8c11813 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:24.219686 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-99c14348-a6d4-49ad-9feb-dbbca8c11813 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:24.221213 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-99c14348-a6d4-49ad-9feb-dbbca8c11813 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:24.222698 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-99c14348-a6d4-49ad-9feb-dbbca8c11813 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1656 microversion: 2.20 time: 0.241878 Jun 16 19:04:24.223002 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 326/627] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:04:23 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1656 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:04:24.280017 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-8a5f975a-7ef6-4f37-87b8-c11293ab84d5 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:24.280663 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-8a5f975a-7ef6-4f37-87b8-c11293ab84d5 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] [instance: c771affd-c89b-412f-8ece-422ececa188a] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:24.282888 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_cell0:SELECT=2 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:04:24.289698 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_cell0:SELECT=6 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:04:24.297140 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-8a5f975a-7ef6-4f37-87b8-c11293ab84d5 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:24.297630 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-8a5f975a-7ef6-4f37-87b8-c11293ab84d5 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:24.298448 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-8a5f975a-7ef6-4f37-87b8-c11293ab84d5 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:24.298950 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-8a5f975a-7ef6-4f37-87b8-c11293ab84d5 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:24.338081 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [req-e7b91736-ff6b-41d2-a5d2-7fd79cdc5076 req-66ac423e-9891-46f2-a5af-96f8fd15ab9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c077a29-12e0-48af-a8b6-43d0b5a79bf4", "name": "network-vif-deleted", "tag": "3e9e841e-467e-4321-a3d7-1999929bc359"}]} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:04:24.363909 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-e7b91736-ff6b-41d2-a5d2-7fd79cdc5076 req-66ac423e-9891-46f2-a5af-96f8fd15ab9f service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:24.365013 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-e7b91736-ff6b-41d2-a5d2-7fd79cdc5076 req-66ac423e-9891-46f2-a5af-96f8fd15ab9f service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:24.389429 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.compute.server_external_events [req-e7b91736-ff6b-41d2-a5d2-7fd79cdc5076 req-66ac423e-9891-46f2-a5af-96f8fd15ab9f service nova] Creating event network-vif-deleted:3e9e841e-467e-4321-a3d7-1999929bc359 for instance 1c077a29-12e0-48af-a8b6-43d0b5a79bf4 on hv-cinder-84617 Jun 16 19:04:24.396751 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [req-e7b91736-ff6b-41d2-a5d2-7fd79cdc5076 req-66ac423e-9891-46f2-a5af-96f8fd15ab9f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062128 Jun 16 19:04:24.398354 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 327/628] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:04:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:04:24.412937 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-e3b021d2-98d3-488b-9931-c90bd3a49016 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:24.413886 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-e3b021d2-98d3-488b-9931-c90bd3a49016 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] [instance: c4277200-c999-4c53-85de-b2a8b120cd6d] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:24.437589 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-e3b021d2-98d3-488b-9931-c90bd3a49016 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:24.437934 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-e3b021d2-98d3-488b-9931-c90bd3a49016 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:24.438802 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-e3b021d2-98d3-488b-9931-c90bd3a49016 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:24.439438 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-e3b021d2-98d3-488b-9931-c90bd3a49016 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:24.454861 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-8a5f975a-7ef6-4f37-87b8-c11293ab84d5 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb08a57a393d4c8591da42cd5e92aca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c879d7f44189ab76e377c33f5e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:24.464602 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-8a5f975a-7ef6-4f37-87b8-c11293ab84d5 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] 10.222.0.70 "GET /compute/v2.1/servers/c771affd-c89b-412f-8ece-422ececa188a" status: 200 len: 1319 microversion: 2.1 time: 0.188591 Jun 16 19:04:24.468270 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 302/629] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:24 2022] GET /compute/v2.1/servers/c771affd-c89b-412f-8ece-422ececa188a => generated 1319 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:24.581952 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-e3b021d2-98d3-488b-9931-c90bd3a49016 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27db09b804fa426a83f103cf5dd116a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629634dc3dc54893b68cb9c9dc08505d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:24.589799 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-e3b021d2-98d3-488b-9931-c90bd3a49016 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] 10.222.0.70 "GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d" status: 200 len: 1567 microversion: 2.1 time: 0.185993 Jun 16 19:04:24.590435 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 328/630] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:24 2022] GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d => generated 1567 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:25.241633 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-8cbc52d3-1188-4a64-a7bd-01f82892e8d9 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:25.242242 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-8cbc52d3-1188-4a64-a7bd-01f82892e8d9 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:25.248662 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-8cbc52d3-1188-4a64-a7bd-01f82892e8d9 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:25.249106 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-8cbc52d3-1188-4a64-a7bd-01f82892e8d9 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:25.249873 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-8cbc52d3-1188-4a64-a7bd-01f82892e8d9 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:25.250340 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-8cbc52d3-1188-4a64-a7bd-01f82892e8d9 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:25.287070 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-8cbc52d3-1188-4a64-a7bd-01f82892e8d9 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:25.287900 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-8cbc52d3-1188-4a64-a7bd-01f82892e8d9 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:25.288083 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.objects.instance [None req-8cbc52d3-1188-4a64-a7bd-01f82892e8d9 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lazy-loading 'fault' on Instance uuid 1c077a29-12e0-48af-a8b6-43d0b5a79bf4 {{(pid=117850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:04:25.330949 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-8cbc52d3-1188-4a64-a7bd-01f82892e8d9 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:25.340943 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-8cbc52d3-1188-4a64-a7bd-01f82892e8d9 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:25.342674 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-8cbc52d3-1188-4a64-a7bd-01f82892e8d9 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:25.344100 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-8cbc52d3-1188-4a64-a7bd-01f82892e8d9 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 200 len: 1371 microversion: 2.20 time: 0.106724 Jun 16 19:04:25.344660 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 303/631] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:04:25 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 1371 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:04:25.481443 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-d12de128-1255-4533-8869-7db820b2df88 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:25.481994 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-d12de128-1255-4533-8869-7db820b2df88 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] [instance: c771affd-c89b-412f-8ece-422ececa188a] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:25.488709 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d12de128-1255-4533-8869-7db820b2df88 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:25.489642 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d12de128-1255-4533-8869-7db820b2df88 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:25.490598 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d12de128-1255-4533-8869-7db820b2df88 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:25.491046 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d12de128-1255-4533-8869-7db820b2df88 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:25.606702 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-ac8dbac6-f92d-4ea5-971a-7b3442cd8787 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:25.607567 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-ac8dbac6-f92d-4ea5-971a-7b3442cd8787 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] [instance: c4277200-c999-4c53-85de-b2a8b120cd6d] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:25.616390 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-ac8dbac6-f92d-4ea5-971a-7b3442cd8787 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:25.617625 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-ac8dbac6-f92d-4ea5-971a-7b3442cd8787 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:25.618432 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-ac8dbac6-f92d-4ea5-971a-7b3442cd8787 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:25.618900 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-ac8dbac6-f92d-4ea5-971a-7b3442cd8787 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:25.636293 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-d12de128-1255-4533-8869-7db820b2df88 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb08a57a393d4c8591da42cd5e92aca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c879d7f44189ab76e377c33f5e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:25.652426 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-d12de128-1255-4533-8869-7db820b2df88 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] 10.222.0.70 "GET /compute/v2.1/servers/c771affd-c89b-412f-8ece-422ececa188a" status: 200 len: 1509 microversion: 2.1 time: 0.174858 Jun 16 19:04:25.653011 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 329/632] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:25 2022] GET /compute/v2.1/servers/c771affd-c89b-412f-8ece-422ececa188a => generated 1509 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:25.669650 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-aca9e89e-ca64-41f4-a688-3067fa241399 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b25520af-ace9-4f00-bd77-43a7133fbc70", "device": "/dev/sdb"}} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:04:25.670795 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-aca9e89e-ca64-41f4-a688-3067fa241399 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] [instance: c771affd-c89b-412f-8ece-422ececa188a] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:25.677954 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-aca9e89e-ca64-41f4-a688-3067fa241399 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:25.678400 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-aca9e89e-ca64-41f4-a688-3067fa241399 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:25.679197 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-aca9e89e-ca64-41f4-a688-3067fa241399 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:25.679856 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-aca9e89e-ca64-41f4-a688-3067fa241399 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:25.792812 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-ac8dbac6-f92d-4ea5-971a-7b3442cd8787 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27db09b804fa426a83f103cf5dd116a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629634dc3dc54893b68cb9c9dc08505d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:25.797209 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:04:25.809997 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-ac8dbac6-f92d-4ea5-971a-7b3442cd8787 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] 10.222.0.70 "GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d" status: 200 len: 1567 microversion: 2.1 time: 0.206733 Jun 16 19:04:25.810850 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 304/633] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:25 2022] GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d => generated 1567 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:25.984153 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-aca9e89e-ca64-41f4-a688-3067fa241399 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] 10.222.0.70 "POST /compute/v2.1/servers/c771affd-c89b-412f-8ece-422ececa188a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.318212 Jun 16 19:04:25.984788 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 330/634] 10.222.0.70 () {60 vars in 1322 bytes} [Thu Jun 16 19:04:25 2022] POST /compute/v2.1/servers/c771affd-c89b-412f-8ece-422ececa188a/os-volume_attachments => generated 194 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:04:26.362894 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-61a3debc-a09b-472a-8c9f-0925bab9963e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:26.363480 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-61a3debc-a09b-472a-8c9f-0925bab9963e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:26.371866 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-61a3debc-a09b-472a-8c9f-0925bab9963e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:26.372318 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-61a3debc-a09b-472a-8c9f-0925bab9963e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:26.373086 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-61a3debc-a09b-472a-8c9f-0925bab9963e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:26.373527 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-61a3debc-a09b-472a-8c9f-0925bab9963e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:26.388660 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.wsgi [None req-61a3debc-a09b-472a-8c9f-0925bab9963e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] HTTP exception thrown: Instance 1c077a29-12e0-48af-a8b6-43d0b5a79bf4 could not be found. Jun 16 19:04:26.390400 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-61a3debc-a09b-472a-8c9f-0925bab9963e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Request method failure captured: Jun 16 19:04:26.390400 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: request: GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 HTTP/1.1 Jun 16 19:04:26.390400 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Accept: application/json Jun 16 19:04:26.390400 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Accept-Encoding: identity Jun 16 19:04:26.390400 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Connection: close Jun 16 19:04:26.390400 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Content-Length: 0 Jun 16 19:04:26.390400 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Content-Type: application/json Jun 16 19:04:26.390400 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Host: 10.222.0.70 Jun 16 19:04:26.390400 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Openstack-System-Scope: None Jun 16 19:04:26.390400 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: User-Agent: python-urllib3/1.26.9 Jun 16 19:04:26.390400 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Auth-Token: gAAAAABiq32OQiza-NSy8hW_I29443OfPOvR91QNA9ClbVuA-Bbd5xRGQHwQYumw9wG3Iz--EsTEyKvr7WbWYvDTJ66Dh8zuZcOad2PTE_vlGjyzTmbcL5O3rlxOIwqedWIoQqpJmwDL8kDUbc1txpCl8MtEXCrt-37yneyXWSj7JbCe7k7eTU0 Jun 16 19:04:26.390400 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Domain-Id: None Jun 16 19:04:26.390400 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Domain-Name: None Jun 16 19:04:26.390400 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Identity-Status: Confirmed Jun 16 19:04:26.390400 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Is-Admin-Project: True Jun 16 19:04:26.390400 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 19:04:26.390400 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Domain-Id: default Jun 16 19:04:26.390400 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Domain-Name: Default Jun 16 19:04:26.390400 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Id: 057aef18c52b49a382450331694c04d6 Jun 16 19:04:26.390400 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1010047508 Jun 16 19:04:26.390400 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Role: member,reader Jun 16 19:04:26.390400 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Roles: member,reader Jun 16 19:04:26.392112 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/057aef18c52b49a382450331694c04d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_057aef18c52b49a382450331694c04d6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/057aef18c52b49a382450331694c04d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/057aef18c52b49a382450331694c04d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 16 19:04:26.392112 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1010047508 Jun 16 19:04:26.392112 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant-Id: 057aef18c52b49a382450331694c04d6 Jun 16 19:04:26.392112 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1010047508 Jun 16 19:04:26.392112 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User: tempest-AttachVolumeShelveTestJSON-1010047508-project Jun 16 19:04:26.392112 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Domain-Id: default Jun 16 19:04:26.392112 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Domain-Name: Default Jun 16 19:04:26.392112 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Id: 04327f3d7b844ddb88cf4a81145634c4 Jun 16 19:04:26.392112 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1010047508-project Jun 16 19:04:26.392112 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: method: > Jun 16 19:04:26.392112 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: exception: Instance 1c077a29-12e0-48af-a8b6-43d0b5a79bf4 could not be found. Jun 16 19:04:26.392112 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: action_args: {'id': '1c077a29-12e0-48af-a8b6-43d0b5a79bf4'} Jun 16 19:04:26.393241 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:04:26.393241 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:04:26.393241 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:04:26.393241 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:04:26.393241 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:04:26.393241 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:04:26.393241 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:04:26.393241 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:04:26.393241 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:04:26.393241 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:04:26.393241 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c077a29-12e0-48af-a8b6-43d0b5a79bf4 could not be found. Jun 16 19:04:26.393241 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:04:26.393241 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:04:26.393241 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:04:26.393241 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:04:26.393241 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:04:26.393241 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:04:26.393241 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:04:26.393241 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:04:26.393241 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:04:26.394655 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:04:26.394655 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:04:26.394655 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:04:26.394655 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:04:26.394655 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:04:26.394655 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:04:26.394655 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:04:26.394655 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c077a29-12e0-48af-a8b6-43d0b5a79bf4 could not be found. Jun 16 19:04:26.394655 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:04:26.394655 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:04:26.394655 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:04:26.394655 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:04:26.394655 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:04:26.394655 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:04:26.394655 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:04:26.394655 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:04:26.394655 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c077a29-12e0-48af-a8b6-43d0b5a79bf4 could not be found. Jun 16 19:04:26.394655 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:04:26.396535 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-61a3debc-a09b-472a-8c9f-0925bab9963e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Returning 404 to user: Instance 1c077a29-12e0-48af-a8b6-43d0b5a79bf4 could not be found. {{(pid=117850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:04:26.396535 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-61a3debc-a09b-472a-8c9f-0925bab9963e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 404 len: 111 microversion: 2.20 time: 0.033077 Jun 16 19:04:26.396535 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 305/635] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:04:26 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 19:04:26.403200 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-7a552f92-dd02-4b6c-929b-6fdb83f6eb20 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '.version_select at 0x7f12e5e44ee0>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:26.421878 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-7a552f92-dd02-4b6c-929b-6fdb83f6eb20 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-170023621" status: 204 len: 0 microversion: 2.20 time: 0.023879 Jun 16 19:04:26.422739 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 331/636] 10.222.0.70 () {60 vars in 1258 bytes} [Thu Jun 16 19:04:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-170023621 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 19:04:26.827954 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-656fab36-547a-4774-a21c-a54be7dc3184 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:26.828813 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-656fab36-547a-4774-a21c-a54be7dc3184 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] [instance: c4277200-c999-4c53-85de-b2a8b120cd6d] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:26.836853 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-656fab36-547a-4774-a21c-a54be7dc3184 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:26.837341 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-656fab36-547a-4774-a21c-a54be7dc3184 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:26.838173 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-656fab36-547a-4774-a21c-a54be7dc3184 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:26.838816 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-656fab36-547a-4774-a21c-a54be7dc3184 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:27.090755 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-656fab36-547a-4774-a21c-a54be7dc3184 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27db09b804fa426a83f103cf5dd116a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629634dc3dc54893b68cb9c9dc08505d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:27.098990 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-656fab36-547a-4774-a21c-a54be7dc3184 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] 10.222.0.70 "GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d" status: 200 len: 1567 microversion: 2.1 time: 0.274599 Jun 16 19:04:27.100013 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 306/637] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:26 2022] GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d => generated 1567 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:27.397110 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-3975ff03-0573-4f38-a181-f65c6f65a055 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Action: 'create', calling method: .version_select at 0x7f12e5d78670>, body: {"keypair": {"name": "tempest-keypair-1108086237", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAlpjBLmPu6eVohHVmrI1ofMXACfix8u9/Uvv9GhJi+gX78x+//NE2AI/L2eZ6XFliD/Yv/1nNlK2L3oPA9eUClWsnzDcE6rodZ2cBl6jnKdHE3QVdOeUWL1spzmq66rtg=="}} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:04:27.412212 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.quota [None req-3975ff03-0573-4f38-a181-f65c6f65a055 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Getting quotas for project 057aef18c52b49a382450331694c04d6. Resources: {'key_pairs'} {{(pid=117852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:04:27.416528 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.quota [None req-3975ff03-0573-4f38-a181-f65c6f65a055 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Getting quotas for user 04327f3d7b844ddb88cf4a81145634c4 and project 057aef18c52b49a382450331694c04d6. Resources: {'key_pairs'} {{(pid=117852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:04:27.438151 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-3975ff03-0573-4f38-a181-f65c6f65a055 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.046287 Jun 16 19:04:27.438765 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 332/638] 10.222.0.70 () {62 vars in 1199 bytes} [Thu Jun 16 19:04:27 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 48 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 16 19:04:28.116807 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-56ae67eb-1f14-43d3-905d-d4edf4ec97cd tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:28.117428 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-56ae67eb-1f14-43d3-905d-d4edf4ec97cd tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] [instance: c4277200-c999-4c53-85de-b2a8b120cd6d] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:28.123971 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-56ae67eb-1f14-43d3-905d-d4edf4ec97cd tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:28.124618 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-56ae67eb-1f14-43d3-905d-d4edf4ec97cd tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:28.125394 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-56ae67eb-1f14-43d3-905d-d4edf4ec97cd tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:28.125833 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-56ae67eb-1f14-43d3-905d-d4edf4ec97cd tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:28.341519 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-56ae67eb-1f14-43d3-905d-d4edf4ec97cd tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27db09b804fa426a83f103cf5dd116a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629634dc3dc54893b68cb9c9dc08505d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:28.350801 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-56ae67eb-1f14-43d3-905d-d4edf4ec97cd tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] 10.222.0.70 "GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d" status: 200 len: 1567 microversion: 2.1 time: 0.238130 Jun 16 19:04:28.351484 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 307/639] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:28 2022] GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d => generated 1567 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:28.839147 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-ec11238c-f086-49be-a4dc-371c1f5b8cc8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1089354144", "imageRef": "1d993e69-7f01-4fe0-ba52-0eae2fa43ddf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "35458482-ba39-48d4-bef8-d8e2a6441bb8"}], "security_groups": [{"name": "tempest-securitygroup--1584768621"}], "key_name": "tempest-keypair-1108086237", "user_data": "}} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:04:28.945306 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.network.neutron [None req-ec11238c-f086-49be-a4dc-371c1f5b8cc8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] validate_networks() for [('35458482-ba39-48d4-bef8-d8e2a6441bb8', None, None, None, None, None)] {{(pid=117852) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:04:29.278168 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 19:04:29.278418 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Thu Jun 16 19:04:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.70) !!! Jun 16 19:04:29.369899 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-0d7194f4-0626-4cca-9ae1-8c43cba17d26 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:29.370760 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-0d7194f4-0626-4cca-9ae1-8c43cba17d26 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] [instance: c4277200-c999-4c53-85de-b2a8b120cd6d] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:29.377544 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0d7194f4-0626-4cca-9ae1-8c43cba17d26 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:29.377986 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0d7194f4-0626-4cca-9ae1-8c43cba17d26 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:29.378783 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0d7194f4-0626-4cca-9ae1-8c43cba17d26 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:29.379211 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0d7194f4-0626-4cca-9ae1-8c43cba17d26 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:29.394159 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.virt.hardware [None req-ec11238c-f086-49be-a4dc-371c1f5b8cc8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Flavor limits 0:0:0 {{(pid=117852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:04:29.394603 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.virt.hardware [None req-ec11238c-f086-49be-a4dc-371c1f5b8cc8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Image limits 0:0:0 {{(pid=117852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:04:29.395140 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.virt.hardware [None req-ec11238c-f086-49be-a4dc-371c1f5b8cc8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Flavor pref 0:0:0 {{(pid=117852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:04:29.395899 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.virt.hardware [None req-ec11238c-f086-49be-a4dc-371c1f5b8cc8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Image pref 0:0:0 {{(pid=117852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:04:29.396124 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.virt.hardware [None req-ec11238c-f086-49be-a4dc-371c1f5b8cc8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:04:29.405534 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ec11238c-f086-49be-a4dc-371c1f5b8cc8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:29.406020 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ec11238c-f086-49be-a4dc-371c1f5b8cc8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:29.407016 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ec11238c-f086-49be-a4dc-371c1f5b8cc8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:29.407461 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ec11238c-f086-49be-a4dc-371c1f5b8cc8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:29.424637 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.quota [None req-ec11238c-f086-49be-a4dc-371c1f5b8cc8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Getting quotas for project 057aef18c52b49a382450331694c04d6. Resources: {'cores', 'ram', 'instances'} {{(pid=117852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:04:29.430447 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.quota [None req-ec11238c-f086-49be-a4dc-371c1f5b8cc8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Getting quotas for user 04327f3d7b844ddb88cf4a81145634c4 and project 057aef18c52b49a382450331694c04d6. Resources: {'cores', 'ram', 'instances'} {{(pid=117852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:04:29.441785 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-ec11238c-f086-49be-a4dc-371c1f5b8cc8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Going to run 1 instances... {{(pid=117852) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:04:29.444990 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-ec11238c-f086-49be-a4dc-371c1f5b8cc8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1d993e69-7f01-4fe0-ba52-0eae2fa43ddf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117852) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:04:29.494475 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-ec11238c-f086-49be-a4dc-371c1f5b8cc8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.660158 Jun 16 19:04:29.495297 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 333/640] 10.222.0.70 () {62 vars in 1187 bytes} [Thu Jun 16 19:04:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jun 16 19:04:29.508178 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-e026f4af-2ffd-4dbb-86c4-668f63ce5218 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:29.508958 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-e026f4af-2ffd-4dbb-86c4-668f63ce5218 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:29.517329 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-0d7194f4-0626-4cca-9ae1-8c43cba17d26 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27db09b804fa426a83f103cf5dd116a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629634dc3dc54893b68cb9c9dc08505d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:29.526540 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-0d7194f4-0626-4cca-9ae1-8c43cba17d26 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] 10.222.0.70 "GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d" status: 200 len: 1567 microversion: 2.1 time: 0.161840 Jun 16 19:04:29.536034 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 308/641] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:29 2022] GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:29.564883 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-e026f4af-2ffd-4dbb-86c4-668f63ce5218 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:29.573853 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-e026f4af-2ffd-4dbb-86c4-668f63ce5218 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:29.575507 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-e026f4af-2ffd-4dbb-86c4-668f63ce5218 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:29.577084 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-e026f4af-2ffd-4dbb-86c4-668f63ce5218 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 200 len: 1282 microversion: 2.20 time: 0.075399 Jun 16 19:04:29.578057 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 334/642] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:04:29 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 1282 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:04:30.543823 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-a7572a5d-bee6-4770-88cf-bddbe2bb103c tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:30.544437 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-a7572a5d-bee6-4770-88cf-bddbe2bb103c tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] [instance: c4277200-c999-4c53-85de-b2a8b120cd6d] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:30.551308 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-a7572a5d-bee6-4770-88cf-bddbe2bb103c tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:30.552930 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-a7572a5d-bee6-4770-88cf-bddbe2bb103c tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:30.553787 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-a7572a5d-bee6-4770-88cf-bddbe2bb103c tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:30.554493 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-a7572a5d-bee6-4770-88cf-bddbe2bb103c tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:30.596788 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-f29560d4-51cc-473d-a18f-feebf880a63a tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:30.597308 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-f29560d4-51cc-473d-a18f-feebf880a63a tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:30.606719 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f29560d4-51cc-473d-a18f-feebf880a63a tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:30.607504 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f29560d4-51cc-473d-a18f-feebf880a63a tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:30.608578 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f29560d4-51cc-473d-a18f-feebf880a63a tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:30.609590 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f29560d4-51cc-473d-a18f-feebf880a63a tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:30.708972 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-f29560d4-51cc-473d-a18f-feebf880a63a tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:30.714660 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-a7572a5d-bee6-4770-88cf-bddbe2bb103c tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27db09b804fa426a83f103cf5dd116a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629634dc3dc54893b68cb9c9dc08505d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:30.726304 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-f29560d4-51cc-473d-a18f-feebf880a63a tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:30.728768 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-f29560d4-51cc-473d-a18f-feebf880a63a tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:30.730854 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-f29560d4-51cc-473d-a18f-feebf880a63a tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 200 len: 1352 microversion: 2.20 time: 0.138647 Jun 16 19:04:30.731093 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-a7572a5d-bee6-4770-88cf-bddbe2bb103c tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] 10.222.0.70 "GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d" status: 200 len: 1567 microversion: 2.1 time: 0.190975 Jun 16 19:04:30.731836 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 335/643] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:04:30 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 1352 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:04:30.732322 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 309/644] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:30 2022] GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d => generated 1567 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:31.748275 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-8d472573-30c5-4d76-98aa-6d434dc757c6 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:31.748887 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-8d472573-30c5-4d76-98aa-6d434dc757c6 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] [instance: c4277200-c999-4c53-85de-b2a8b120cd6d] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:31.753930 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-33c8ac77-5f42-466e-838d-7ce9dac601ad tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:31.755345 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-33c8ac77-5f42-466e-838d-7ce9dac601ad tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:31.763685 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-33c8ac77-5f42-466e-838d-7ce9dac601ad tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:31.763929 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-33c8ac77-5f42-466e-838d-7ce9dac601ad tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:31.764759 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-33c8ac77-5f42-466e-838d-7ce9dac601ad tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:31.765266 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-8d472573-30c5-4d76-98aa-6d434dc757c6 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:31.765428 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-33c8ac77-5f42-466e-838d-7ce9dac601ad tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:31.765841 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-8d472573-30c5-4d76-98aa-6d434dc757c6 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:31.766631 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-8d472573-30c5-4d76-98aa-6d434dc757c6 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:31.767223 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-8d472573-30c5-4d76-98aa-6d434dc757c6 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:31.903410 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-33c8ac77-5f42-466e-838d-7ce9dac601ad tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:31.913178 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-33c8ac77-5f42-466e-838d-7ce9dac601ad tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:31.914790 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-33c8ac77-5f42-466e-838d-7ce9dac601ad tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:31.916030 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-33c8ac77-5f42-466e-838d-7ce9dac601ad tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 200 len: 1408 microversion: 2.20 time: 0.165764 Jun 16 19:04:31.916794 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 310/645] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:04:31 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 1408 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:04:32.011623 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-8d472573-30c5-4d76-98aa-6d434dc757c6 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27db09b804fa426a83f103cf5dd116a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629634dc3dc54893b68cb9c9dc08505d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:32.019812 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-8d472573-30c5-4d76-98aa-6d434dc757c6 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] 10.222.0.70 "GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d" status: 200 len: 1567 microversion: 2.1 time: 0.275294 Jun 16 19:04:32.020735 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 336/646] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:31 2022] GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d => generated 1567 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:04:32.210326 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [req-71b0402b-2122-422d-90ca-84aeadbe73a4 req-6dc87fc6-5279-4444-89e2-51dbbccea67f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac8de877-3a07-4017-99fb-45b37ef123b6", "tag": "8bd9db24-3ac1-4beb-93fd-9cdfca791f22"}]} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:04:32.219151 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-71b0402b-2122-422d-90ca-84aeadbe73a4 req-6dc87fc6-5279-4444-89e2-51dbbccea67f service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:32.219599 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-71b0402b-2122-422d-90ca-84aeadbe73a4 req-6dc87fc6-5279-4444-89e2-51dbbccea67f service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:32.237114 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.compute.server_external_events [req-71b0402b-2122-422d-90ca-84aeadbe73a4 req-6dc87fc6-5279-4444-89e2-51dbbccea67f service nova] Creating event network-changed:8bd9db24-3ac1-4beb-93fd-9cdfca791f22 for instance ac8de877-3a07-4017-99fb-45b37ef123b6 on hv-cinder-84617 Jun 16 19:04:32.242372 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [req-71b0402b-2122-422d-90ca-84aeadbe73a4 req-6dc87fc6-5279-4444-89e2-51dbbccea67f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038224 Jun 16 19:04:32.243176 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 311/647] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:04:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:04:32.936539 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-52c7b23e-b9bb-4d08-9b39-058a1d5d4f70 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:32.937781 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-52c7b23e-b9bb-4d08-9b39-058a1d5d4f70 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:32.945376 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-52c7b23e-b9bb-4d08-9b39-058a1d5d4f70 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:32.945818 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-52c7b23e-b9bb-4d08-9b39-058a1d5d4f70 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:32.946599 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-52c7b23e-b9bb-4d08-9b39-058a1d5d4f70 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:32.947032 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-52c7b23e-b9bb-4d08-9b39-058a1d5d4f70 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:33.038700 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-fb89280c-1b14-45d1-aaa4-4f455aecf87c tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:33.040198 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-fb89280c-1b14-45d1-aaa4-4f455aecf87c tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] [instance: c4277200-c999-4c53-85de-b2a8b120cd6d] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:33.046769 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-fb89280c-1b14-45d1-aaa4-4f455aecf87c tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:33.047246 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-fb89280c-1b14-45d1-aaa4-4f455aecf87c tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:33.048015 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-fb89280c-1b14-45d1-aaa4-4f455aecf87c tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:33.048451 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-fb89280c-1b14-45d1-aaa4-4f455aecf87c tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:33.168404 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-52c7b23e-b9bb-4d08-9b39-058a1d5d4f70 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:33.177758 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-52c7b23e-b9bb-4d08-9b39-058a1d5d4f70 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:33.179451 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-52c7b23e-b9bb-4d08-9b39-058a1d5d4f70 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:33.180572 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-52c7b23e-b9bb-4d08-9b39-058a1d5d4f70 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 200 len: 1408 microversion: 2.20 time: 0.247977 Jun 16 19:04:33.181129 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 337/648] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:04:32 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 1408 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:04:33.195130 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-fb89280c-1b14-45d1-aaa4-4f455aecf87c tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27db09b804fa426a83f103cf5dd116a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629634dc3dc54893b68cb9c9dc08505d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:33.202671 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-fb89280c-1b14-45d1-aaa4-4f455aecf87c tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] 10.222.0.70 "GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d" status: 200 len: 1567 microversion: 2.1 time: 0.169228 Jun 16 19:04:33.203234 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 312/649] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:33 2022] GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:04:34.198861 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-f1484619-79bd-4cb5-886e-f7b8ac2b4058 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:34.199557 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-f1484619-79bd-4cb5-886e-f7b8ac2b4058 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:34.206036 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f1484619-79bd-4cb5-886e-f7b8ac2b4058 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:34.206488 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f1484619-79bd-4cb5-886e-f7b8ac2b4058 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:34.207412 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f1484619-79bd-4cb5-886e-f7b8ac2b4058 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:34.208523 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f1484619-79bd-4cb5-886e-f7b8ac2b4058 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:34.219583 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-218be2f8-39d5-4f26-ba16-c4e16ea58954 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:34.220214 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-218be2f8-39d5-4f26-ba16-c4e16ea58954 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] [instance: c4277200-c999-4c53-85de-b2a8b120cd6d] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:34.227169 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-218be2f8-39d5-4f26-ba16-c4e16ea58954 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:34.227628 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-218be2f8-39d5-4f26-ba16-c4e16ea58954 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:34.228403 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-218be2f8-39d5-4f26-ba16-c4e16ea58954 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:34.228843 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-218be2f8-39d5-4f26-ba16-c4e16ea58954 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:34.345687 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-f1484619-79bd-4cb5-886e-f7b8ac2b4058 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:34.354540 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-f1484619-79bd-4cb5-886e-f7b8ac2b4058 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:34.356063 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-f1484619-79bd-4cb5-886e-f7b8ac2b4058 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:34.357201 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-f1484619-79bd-4cb5-886e-f7b8ac2b4058 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 200 len: 1408 microversion: 2.20 time: 0.162307 Jun 16 19:04:34.358121 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 338/650] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:04:34 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 1408 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:04:34.370367 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-218be2f8-39d5-4f26-ba16-c4e16ea58954 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27db09b804fa426a83f103cf5dd116a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629634dc3dc54893b68cb9c9dc08505d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:34.377940 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-218be2f8-39d5-4f26-ba16-c4e16ea58954 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] 10.222.0.70 "GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d" status: 200 len: 1567 microversion: 2.1 time: 0.162172 Jun 16 19:04:34.378502 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 313/651] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:34 2022] GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:04:35.375762 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-3ecee563-f782-43f1-b9a8-c17267be686b tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:35.376328 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-3ecee563-f782-43f1-b9a8-c17267be686b tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:35.384004 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-3ecee563-f782-43f1-b9a8-c17267be686b tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:35.384486 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-3ecee563-f782-43f1-b9a8-c17267be686b tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:35.385516 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-3ecee563-f782-43f1-b9a8-c17267be686b tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:35.386373 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-3ecee563-f782-43f1-b9a8-c17267be686b tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:35.397181 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-f1c4fc89-4dd2-4d37-b920-8398e69d3797 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:35.397800 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-f1c4fc89-4dd2-4d37-b920-8398e69d3797 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] [instance: c4277200-c999-4c53-85de-b2a8b120cd6d] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:35.405306 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-f1c4fc89-4dd2-4d37-b920-8398e69d3797 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:35.405767 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-f1c4fc89-4dd2-4d37-b920-8398e69d3797 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:35.406779 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-f1c4fc89-4dd2-4d37-b920-8398e69d3797 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:35.407299 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-f1c4fc89-4dd2-4d37-b920-8398e69d3797 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:35.522394 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-3ecee563-f782-43f1-b9a8-c17267be686b tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:35.530772 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-3ecee563-f782-43f1-b9a8-c17267be686b tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:35.532290 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-3ecee563-f782-43f1-b9a8-c17267be686b tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:35.533463 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-3ecee563-f782-43f1-b9a8-c17267be686b tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 200 len: 1408 microversion: 2.20 time: 0.161953 Jun 16 19:04:35.534028 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 339/652] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:04:35 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 1408 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:04:35.539412 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-f1c4fc89-4dd2-4d37-b920-8398e69d3797 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27db09b804fa426a83f103cf5dd116a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629634dc3dc54893b68cb9c9dc08505d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:35.547211 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-f1c4fc89-4dd2-4d37-b920-8398e69d3797 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] 10.222.0.70 "GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d" status: 200 len: 1567 microversion: 2.1 time: 0.154322 Jun 16 19:04:35.547764 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 314/653] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:35 2022] GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:36.551984 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-18b7e708-99ba-40c5-8a42-bb3d80ff8db3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:36.552595 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-18b7e708-99ba-40c5-8a42-bb3d80ff8db3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:36.559216 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-18b7e708-99ba-40c5-8a42-bb3d80ff8db3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:36.559673 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-18b7e708-99ba-40c5-8a42-bb3d80ff8db3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:36.560443 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-18b7e708-99ba-40c5-8a42-bb3d80ff8db3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:36.560883 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-18b7e708-99ba-40c5-8a42-bb3d80ff8db3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:36.564584 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-0a412a53-6e37-4187-82bb-e3d924242988 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:36.565227 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-0a412a53-6e37-4187-82bb-e3d924242988 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] [instance: c4277200-c999-4c53-85de-b2a8b120cd6d] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:36.572424 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0a412a53-6e37-4187-82bb-e3d924242988 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:36.572870 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0a412a53-6e37-4187-82bb-e3d924242988 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:36.573633 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0a412a53-6e37-4187-82bb-e3d924242988 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:36.574069 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0a412a53-6e37-4187-82bb-e3d924242988 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:36.697907 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-18b7e708-99ba-40c5-8a42-bb3d80ff8db3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:36.705788 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-18b7e708-99ba-40c5-8a42-bb3d80ff8db3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:36.708242 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-18b7e708-99ba-40c5-8a42-bb3d80ff8db3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:36.710800 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-18b7e708-99ba-40c5-8a42-bb3d80ff8db3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 200 len: 1408 microversion: 2.20 time: 0.161694 Jun 16 19:04:36.711323 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 340/654] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:04:36 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 1408 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:04:36.712259 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-0a412a53-6e37-4187-82bb-e3d924242988 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27db09b804fa426a83f103cf5dd116a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629634dc3dc54893b68cb9c9dc08505d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:36.719757 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-0a412a53-6e37-4187-82bb-e3d924242988 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] 10.222.0.70 "GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d" status: 200 len: 1567 microversion: 2.1 time: 0.158924 Jun 16 19:04:36.720359 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 315/655] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:36 2022] GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:04:37.729608 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-c1048fa2-23ad-49da-8b05-10eb4216b076 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:37.730236 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-c1048fa2-23ad-49da-8b05-10eb4216b076 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:37.736594 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-39044787-7a1e-4e6c-a71b-f3df11af3e8c tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:37.737220 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-39044787-7a1e-4e6c-a71b-f3df11af3e8c tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] [instance: c4277200-c999-4c53-85de-b2a8b120cd6d] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:37.737351 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-c1048fa2-23ad-49da-8b05-10eb4216b076 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:37.737681 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-c1048fa2-23ad-49da-8b05-10eb4216b076 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:37.738614 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-c1048fa2-23ad-49da-8b05-10eb4216b076 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:37.739067 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-c1048fa2-23ad-49da-8b05-10eb4216b076 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:37.743839 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-39044787-7a1e-4e6c-a71b-f3df11af3e8c tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:37.744298 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-39044787-7a1e-4e6c-a71b-f3df11af3e8c tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:37.745066 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-39044787-7a1e-4e6c-a71b-f3df11af3e8c tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:37.745503 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-39044787-7a1e-4e6c-a71b-f3df11af3e8c tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:37.761556 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:04:37.891313 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-c1048fa2-23ad-49da-8b05-10eb4216b076 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:37.900707 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-c1048fa2-23ad-49da-8b05-10eb4216b076 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:37.901417 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-39044787-7a1e-4e6c-a71b-f3df11af3e8c tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27db09b804fa426a83f103cf5dd116a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629634dc3dc54893b68cb9c9dc08505d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:37.902263 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-c1048fa2-23ad-49da-8b05-10eb4216b076 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:37.903420 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-c1048fa2-23ad-49da-8b05-10eb4216b076 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 200 len: 1408 microversion: 2.20 time: 0.177902 Jun 16 19:04:37.903984 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 341/656] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:04:37 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 1408 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:04:37.912200 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-39044787-7a1e-4e6c-a71b-f3df11af3e8c tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] 10.222.0.70 "GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d" status: 200 len: 1567 microversion: 2.1 time: 0.178965 Jun 16 19:04:37.919095 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 316/657] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:37 2022] GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d => generated 1567 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:04:38.922035 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-3a6b45ef-ac6e-44f3-9fb5-d1c5d87568cc tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:38.922681 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-3a6b45ef-ac6e-44f3-9fb5-d1c5d87568cc tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:38.930127 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-3a6b45ef-ac6e-44f3-9fb5-d1c5d87568cc tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:38.930590 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-3a6b45ef-ac6e-44f3-9fb5-d1c5d87568cc tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:38.930973 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-e9cd0c78-5dfe-4f54-b798-1ee47e3106df tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:38.931402 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-3a6b45ef-ac6e-44f3-9fb5-d1c5d87568cc tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:38.931593 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-e9cd0c78-5dfe-4f54-b798-1ee47e3106df tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] [instance: c4277200-c999-4c53-85de-b2a8b120cd6d] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:38.931784 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-3a6b45ef-ac6e-44f3-9fb5-d1c5d87568cc tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:38.937852 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-e9cd0c78-5dfe-4f54-b798-1ee47e3106df tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:38.938302 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-e9cd0c78-5dfe-4f54-b798-1ee47e3106df tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:38.939090 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-e9cd0c78-5dfe-4f54-b798-1ee47e3106df tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:38.939529 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-e9cd0c78-5dfe-4f54-b798-1ee47e3106df tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:39.088630 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-e9cd0c78-5dfe-4f54-b798-1ee47e3106df tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27db09b804fa426a83f103cf5dd116a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629634dc3dc54893b68cb9c9dc08505d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:39.096585 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-e9cd0c78-5dfe-4f54-b798-1ee47e3106df tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] 10.222.0.70 "GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d" status: 200 len: 1567 microversion: 2.1 time: 0.170660 Jun 16 19:04:39.097289 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 317/658] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:38 2022] GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:39.336592 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-3a6b45ef-ac6e-44f3-9fb5-d1c5d87568cc tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:39.344642 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-3a6b45ef-ac6e-44f3-9fb5-d1c5d87568cc tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:39.346174 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-3a6b45ef-ac6e-44f3-9fb5-d1c5d87568cc tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:39.347332 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-3a6b45ef-ac6e-44f3-9fb5-d1c5d87568cc tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 200 len: 1408 microversion: 2.20 time: 0.429240 Jun 16 19:04:39.348007 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 342/659] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:04:38 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 1408 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:04:40.116211 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-0dc8ef9a-8958-4dc1-8ed0-787f81730a96 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:40.116836 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-0dc8ef9a-8958-4dc1-8ed0-787f81730a96 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] [instance: c4277200-c999-4c53-85de-b2a8b120cd6d] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:40.123384 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0dc8ef9a-8958-4dc1-8ed0-787f81730a96 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:40.123837 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0dc8ef9a-8958-4dc1-8ed0-787f81730a96 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:40.124606 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0dc8ef9a-8958-4dc1-8ed0-787f81730a96 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:40.125046 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0dc8ef9a-8958-4dc1-8ed0-787f81730a96 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:40.258702 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-0dc8ef9a-8958-4dc1-8ed0-787f81730a96 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27db09b804fa426a83f103cf5dd116a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629634dc3dc54893b68cb9c9dc08505d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:40.266395 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-0dc8ef9a-8958-4dc1-8ed0-787f81730a96 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] 10.222.0.70 "GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d" status: 200 len: 1567 microversion: 2.1 time: 0.154775 Jun 16 19:04:40.267016 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 318/660] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:40 2022] GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:40.365956 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-d4e64b89-6e0f-4970-8ffa-2e4b0e0b84b6 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:40.366774 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-d4e64b89-6e0f-4970-8ffa-2e4b0e0b84b6 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:40.368453 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_cell0:SELECT=2 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:04:40.369115 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_cell0:SELECT=12 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:04:40.375152 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d4e64b89-6e0f-4970-8ffa-2e4b0e0b84b6 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:40.375592 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d4e64b89-6e0f-4970-8ffa-2e4b0e0b84b6 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:40.376351 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d4e64b89-6e0f-4970-8ffa-2e4b0e0b84b6 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:40.376781 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d4e64b89-6e0f-4970-8ffa-2e4b0e0b84b6 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:40.507626 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-d4e64b89-6e0f-4970-8ffa-2e4b0e0b84b6 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:40.515621 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-d4e64b89-6e0f-4970-8ffa-2e4b0e0b84b6 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:40.517155 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-d4e64b89-6e0f-4970-8ffa-2e4b0e0b84b6 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:40.518249 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-d4e64b89-6e0f-4970-8ffa-2e4b0e0b84b6 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 200 len: 1408 microversion: 2.20 time: 0.156932 Jun 16 19:04:40.518833 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 343/661] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:04:40 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:04:41.284260 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-4a31abd7-240a-4bf6-ace1-c6c43f5408b2 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:41.284836 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-4a31abd7-240a-4bf6-ace1-c6c43f5408b2 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] [instance: c4277200-c999-4c53-85de-b2a8b120cd6d] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:41.292063 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-4a31abd7-240a-4bf6-ace1-c6c43f5408b2 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:41.292510 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-4a31abd7-240a-4bf6-ace1-c6c43f5408b2 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:41.293265 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-4a31abd7-240a-4bf6-ace1-c6c43f5408b2 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:41.293710 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-4a31abd7-240a-4bf6-ace1-c6c43f5408b2 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:41.434842 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-4a31abd7-240a-4bf6-ace1-c6c43f5408b2 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27db09b804fa426a83f103cf5dd116a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629634dc3dc54893b68cb9c9dc08505d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:41.442421 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-4a31abd7-240a-4bf6-ace1-c6c43f5408b2 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] 10.222.0.70 "GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d" status: 200 len: 1567 microversion: 2.1 time: 0.162322 Jun 16 19:04:41.443036 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 319/662] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:41 2022] GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:41.537024 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-9ea7daca-e3ab-4c2a-8d6d-ca5d9eea3e80 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:41.537561 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-9ea7daca-e3ab-4c2a-8d6d-ca5d9eea3e80 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:41.544091 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-9ea7daca-e3ab-4c2a-8d6d-ca5d9eea3e80 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:41.544531 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-9ea7daca-e3ab-4c2a-8d6d-ca5d9eea3e80 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:41.545279 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-9ea7daca-e3ab-4c2a-8d6d-ca5d9eea3e80 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:41.545704 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-9ea7daca-e3ab-4c2a-8d6d-ca5d9eea3e80 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:41.681574 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-9ea7daca-e3ab-4c2a-8d6d-ca5d9eea3e80 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:41.689620 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-9ea7daca-e3ab-4c2a-8d6d-ca5d9eea3e80 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:41.691207 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-9ea7daca-e3ab-4c2a-8d6d-ca5d9eea3e80 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:41.692967 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-9ea7daca-e3ab-4c2a-8d6d-ca5d9eea3e80 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 200 len: 1408 microversion: 2.20 time: 0.160752 Jun 16 19:04:41.693525 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 344/663] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:04:41 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 1408 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:04:42.459378 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-78273743-30a0-4cce-9965-125f9d2ab8e1 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:42.461002 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-78273743-30a0-4cce-9965-125f9d2ab8e1 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] [instance: c4277200-c999-4c53-85de-b2a8b120cd6d] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:42.467331 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-78273743-30a0-4cce-9965-125f9d2ab8e1 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:42.467775 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-78273743-30a0-4cce-9965-125f9d2ab8e1 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:42.468525 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-78273743-30a0-4cce-9965-125f9d2ab8e1 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:42.468956 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-78273743-30a0-4cce-9965-125f9d2ab8e1 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:42.610081 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-78273743-30a0-4cce-9965-125f9d2ab8e1 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27db09b804fa426a83f103cf5dd116a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629634dc3dc54893b68cb9c9dc08505d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:42.617625 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-78273743-30a0-4cce-9965-125f9d2ab8e1 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] 10.222.0.70 "GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d" status: 200 len: 1567 microversion: 2.1 time: 0.162133 Jun 16 19:04:42.618179 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 320/664] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:42 2022] GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:42.710168 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-f205f6c0-c026-45dc-9974-2903823a12ed tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:42.710764 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-f205f6c0-c026-45dc-9974-2903823a12ed tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:42.717788 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f205f6c0-c026-45dc-9974-2903823a12ed tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:42.718244 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f205f6c0-c026-45dc-9974-2903823a12ed tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:42.719126 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f205f6c0-c026-45dc-9974-2903823a12ed tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:42.719568 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f205f6c0-c026-45dc-9974-2903823a12ed tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:42.850434 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-f205f6c0-c026-45dc-9974-2903823a12ed tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:42.858613 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-f205f6c0-c026-45dc-9974-2903823a12ed tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:42.860119 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-f205f6c0-c026-45dc-9974-2903823a12ed tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:42.861221 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-f205f6c0-c026-45dc-9974-2903823a12ed tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 200 len: 1408 microversion: 2.20 time: 0.155118 Jun 16 19:04:42.861768 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 345/665] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:04:42 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:04:43.209238 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [req-06cc784e-5a29-43ff-82cc-8921cbcf1e24 req-b864b0f3-cb17-48df-adee-0f670b5a6999 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac8de877-3a07-4017-99fb-45b37ef123b6", "name": "network-vif-plugged", "status": "completed", "tag": "8bd9db24-3ac1-4beb-93fd-9cdfca791f22"}]} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:04:43.223291 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-06cc784e-5a29-43ff-82cc-8921cbcf1e24 req-b864b0f3-cb17-48df-adee-0f670b5a6999 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:43.223830 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-06cc784e-5a29-43ff-82cc-8921cbcf1e24 req-b864b0f3-cb17-48df-adee-0f670b5a6999 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:43.239340 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.compute.server_external_events [req-06cc784e-5a29-43ff-82cc-8921cbcf1e24 req-b864b0f3-cb17-48df-adee-0f670b5a6999 service nova] Creating event network-vif-plugged:8bd9db24-3ac1-4beb-93fd-9cdfca791f22 for instance ac8de877-3a07-4017-99fb-45b37ef123b6 on hv-cinder-84617 Jun 16 19:04:43.244826 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [req-06cc784e-5a29-43ff-82cc-8921cbcf1e24 req-b864b0f3-cb17-48df-adee-0f670b5a6999 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040197 Jun 16 19:04:43.245948 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 321/666] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:04:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:04:43.634995 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-5b0f1262-2b99-4e99-bca7-186079decc31 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:43.635523 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-5b0f1262-2b99-4e99-bca7-186079decc31 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] [instance: c4277200-c999-4c53-85de-b2a8b120cd6d] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:43.641967 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-5b0f1262-2b99-4e99-bca7-186079decc31 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:43.642532 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-5b0f1262-2b99-4e99-bca7-186079decc31 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:43.643322 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-5b0f1262-2b99-4e99-bca7-186079decc31 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:43.643762 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-5b0f1262-2b99-4e99-bca7-186079decc31 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:43.787989 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-5b0f1262-2b99-4e99-bca7-186079decc31 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27db09b804fa426a83f103cf5dd116a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629634dc3dc54893b68cb9c9dc08505d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:43.797478 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-5b0f1262-2b99-4e99-bca7-186079decc31 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] 10.222.0.70 "GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d" status: 200 len: 1567 microversion: 2.1 time: 0.166366 Jun 16 19:04:43.798095 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 346/667] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:43 2022] GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:43.881727 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-d1a42157-a74a-4f86-9970-7aec2799c8fc tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:43.882463 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-d1a42157-a74a-4f86-9970-7aec2799c8fc tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:43.889664 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d1a42157-a74a-4f86-9970-7aec2799c8fc tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:43.890052 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d1a42157-a74a-4f86-9970-7aec2799c8fc tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:43.890878 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d1a42157-a74a-4f86-9970-7aec2799c8fc tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:43.891315 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d1a42157-a74a-4f86-9970-7aec2799c8fc tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:44.026305 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-d1a42157-a74a-4f86-9970-7aec2799c8fc tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:44.034271 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-d1a42157-a74a-4f86-9970-7aec2799c8fc tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:44.035892 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-d1a42157-a74a-4f86-9970-7aec2799c8fc tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:44.037000 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-d1a42157-a74a-4f86-9970-7aec2799c8fc tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 200 len: 1408 microversion: 2.20 time: 0.161205 Jun 16 19:04:44.037564 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 322/668] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:04:43 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 1408 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:04:44.819241 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-a130dda9-922d-45e4-ae70-afac306ef62c tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:44.819782 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-a130dda9-922d-45e4-ae70-afac306ef62c tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] [instance: c4277200-c999-4c53-85de-b2a8b120cd6d] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:44.826409 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-a130dda9-922d-45e4-ae70-afac306ef62c tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:44.826908 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-a130dda9-922d-45e4-ae70-afac306ef62c tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:44.827682 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-a130dda9-922d-45e4-ae70-afac306ef62c tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:44.828124 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-a130dda9-922d-45e4-ae70-afac306ef62c tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:44.970864 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-a130dda9-922d-45e4-ae70-afac306ef62c tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27db09b804fa426a83f103cf5dd116a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629634dc3dc54893b68cb9c9dc08505d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:44.978626 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-a130dda9-922d-45e4-ae70-afac306ef62c tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] 10.222.0.70 "GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d" status: 200 len: 1568 microversion: 2.1 time: 0.164609 Jun 16 19:04:44.979194 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 347/669] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:44 2022] GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:44.995224 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-e9b03c5c-c86e-4363-ac8a-211818527963 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:04:44.995791 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-e9b03c5c-c86e-4363-ac8a-211818527963 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] [instance: c4277200-c999-4c53-85de-b2a8b120cd6d] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:45.002295 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-e9b03c5c-c86e-4363-ac8a-211818527963 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:45.002775 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-e9b03c5c-c86e-4363-ac8a-211818527963 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:45.003559 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-e9b03c5c-c86e-4363-ac8a-211818527963 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:45.004810 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-e9b03c5c-c86e-4363-ac8a-211818527963 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:45.021185 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_cell1:SELECT=100 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:04:45.056445 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-469bdb6d-e9fc-414c-b5fb-bc3b2cf50e25 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:45.057060 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-469bdb6d-e9fc-414c-b5fb-bc3b2cf50e25 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:45.063970 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-469bdb6d-e9fc-414c-b5fb-bc3b2cf50e25 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:45.064420 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-469bdb6d-e9fc-414c-b5fb-bc3b2cf50e25 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:45.065225 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-469bdb6d-e9fc-414c-b5fb-bc3b2cf50e25 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:45.065663 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-469bdb6d-e9fc-414c-b5fb-bc3b2cf50e25 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:45.081625 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-e9b03c5c-c86e-4363-ac8a-211818527963 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] 10.222.0.70 "POST /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d/action" status: 202 len: 0 microversion: 2.1 time: 0.090017 Jun 16 19:04:45.082231 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 323/670] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Jun 16 19:04:44 2022] POST /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:04:45.090852 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-505ef976-496e-47fa-bd3d-e10cba23be86 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:45.091524 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-505ef976-496e-47fa-bd3d-e10cba23be86 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] [instance: c4277200-c999-4c53-85de-b2a8b120cd6d] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:45.098947 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-505ef976-496e-47fa-bd3d-e10cba23be86 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:45.099408 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-505ef976-496e-47fa-bd3d-e10cba23be86 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:45.100379 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-505ef976-496e-47fa-bd3d-e10cba23be86 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:45.100985 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-505ef976-496e-47fa-bd3d-e10cba23be86 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:45.207131 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-469bdb6d-e9fc-414c-b5fb-bc3b2cf50e25 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:45.216619 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-469bdb6d-e9fc-414c-b5fb-bc3b2cf50e25 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:45.218537 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-469bdb6d-e9fc-414c-b5fb-bc3b2cf50e25 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:45.219698 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-469bdb6d-e9fc-414c-b5fb-bc3b2cf50e25 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 200 len: 1408 microversion: 2.20 time: 0.167238 Jun 16 19:04:45.220255 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 348/671] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:04:45 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 1408 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:04:45.261056 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-505ef976-496e-47fa-bd3d-e10cba23be86 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27db09b804fa426a83f103cf5dd116a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629634dc3dc54893b68cb9c9dc08505d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:45.268705 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-505ef976-496e-47fa-bd3d-e10cba23be86 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] 10.222.0.70 "GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d" status: 200 len: 1516 microversion: 2.1 time: 0.182136 Jun 16 19:04:45.270109 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 324/672] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:45 2022] GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d => generated 1516 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:04:45.359661 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-66965cf3-82cf-4f6f-9cdb-115e1cca85b4 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2128678587"}} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:04:45.360207 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-66965cf3-82cf-4f6f-9cdb-115e1cca85b4 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] [instance: edce90bf-b3d6-49de-a45f-9b65e1759b51] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:45.366920 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-66965cf3-82cf-4f6f-9cdb-115e1cca85b4 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:45.367373 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-66965cf3-82cf-4f6f-9cdb-115e1cca85b4 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:45.368150 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-66965cf3-82cf-4f6f-9cdb-115e1cca85b4 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:45.368269 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-43da2562-f16e-4df3-8f85-ed0773d5fa52 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:45.368586 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-66965cf3-82cf-4f6f-9cdb-115e1cca85b4 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:45.368902 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-43da2562-f16e-4df3-8f85-ed0773d5fa52 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] [instance: c771affd-c89b-412f-8ece-422ececa188a] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:45.375307 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-43da2562-f16e-4df3-8f85-ed0773d5fa52 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:45.375893 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-43da2562-f16e-4df3-8f85-ed0773d5fa52 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:45.376796 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-43da2562-f16e-4df3-8f85-ed0773d5fa52 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:45.377360 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-43da2562-f16e-4df3-8f85-ed0773d5fa52 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:45.483490 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.objects.instance [None req-43da2562-f16e-4df3-8f85-ed0773d5fa52 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lazy-loading 'services' on Instance uuid c771affd-c89b-412f-8ece-422ececa188a {{(pid=117850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:04:45.516120 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.network.security_group_api [None req-66965cf3-82cf-4f6f-9cdb-115e1cca85b4 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Removing security group 5ff40db3-128a-4a4b-aa09-d864e5fc8232 from port 1ff09938-bf10-4206-8fd9-6a39acb93f8c Jun 16 19:04:45.565089 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-43da2562-f16e-4df3-8f85-ed0773d5fa52 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] 10.222.0.70 "DELETE /compute/v2.1/servers/c771affd-c89b-412f-8ece-422ececa188a/os-volume_attachments/b25520af-ace9-4f00-bd77-43a7133fbc70" status: 202 len: 0 microversion: 2.1 time: 0.200968 Jun 16 19:04:45.569967 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 325/673] 10.222.0.70 () {58 vars in 1415 bytes} [Thu Jun 16 19:04:45 2022] DELETE /compute/v2.1/servers/c771affd-c89b-412f-8ece-422ececa188a/os-volume_attachments/b25520af-ace9-4f00-bd77-43a7133fbc70 => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:04:45.901685 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-66965cf3-82cf-4f6f-9cdb-115e1cca85b4 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] 10.222.0.70 "POST /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51/action" status: 202 len: 0 microversion: 2.1 time: 0.545926 Jun 16 19:04:45.902312 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 349/674] 10.222.0.70 () {60 vars in 1277 bytes} [Thu Jun 16 19:04:45 2022] POST /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51/action => generated 0 bytes in 547 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:04:45.926479 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [req-4282724a-8670-48aa-86ba-09ddcffdcedc req-f9e9f160-77a4-433b-9eba-b6aed83a8722 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edce90bf-b3d6-49de-a45f-9b65e1759b51", "tag": "1ff09938-bf10-4206-8fd9-6a39acb93f8c"}]} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:04:45.966166 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-4282724a-8670-48aa-86ba-09ddcffdcedc req-f9e9f160-77a4-433b-9eba-b6aed83a8722 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:45.966961 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-4282724a-8670-48aa-86ba-09ddcffdcedc req-f9e9f160-77a4-433b-9eba-b6aed83a8722 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:46.015949 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.compute.server_external_events [req-4282724a-8670-48aa-86ba-09ddcffdcedc req-f9e9f160-77a4-433b-9eba-b6aed83a8722 service nova] Creating event network-changed:1ff09938-bf10-4206-8fd9-6a39acb93f8c for instance edce90bf-b3d6-49de-a45f-9b65e1759b51 on hv-cinder-84617 Jun 16 19:04:46.033060 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [req-4282724a-8670-48aa-86ba-09ddcffdcedc req-f9e9f160-77a4-433b-9eba-b6aed83a8722 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123031 Jun 16 19:04:46.039694 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 326/675] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:04:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:04:46.246642 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-4c1a36b8-b773-479e-bdba-193f17ae4673 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:46.247284 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-4c1a36b8-b773-479e-bdba-193f17ae4673 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:46.256725 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-4c1a36b8-b773-479e-bdba-193f17ae4673 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:46.257566 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-4c1a36b8-b773-479e-bdba-193f17ae4673 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:46.258699 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-4c1a36b8-b773-479e-bdba-193f17ae4673 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:46.260280 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-4c1a36b8-b773-479e-bdba-193f17ae4673 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:46.290457 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-323baa9b-62bb-472c-9fb4-90619b80b2be tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:46.291546 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-323baa9b-62bb-472c-9fb4-90619b80b2be tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] [instance: c4277200-c999-4c53-85de-b2a8b120cd6d] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:46.300705 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-323baa9b-62bb-472c-9fb4-90619b80b2be tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:46.301502 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-323baa9b-62bb-472c-9fb4-90619b80b2be tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:46.302789 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-323baa9b-62bb-472c-9fb4-90619b80b2be tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:46.303442 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-323baa9b-62bb-472c-9fb4-90619b80b2be tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:46.464776 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-323baa9b-62bb-472c-9fb4-90619b80b2be tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27db09b804fa426a83f103cf5dd116a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629634dc3dc54893b68cb9c9dc08505d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:46.483484 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-323baa9b-62bb-472c-9fb4-90619b80b2be tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] 10.222.0.70 "GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d" status: 200 len: 1518 microversion: 2.1 time: 0.200632 Jun 16 19:04:46.484089 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 327/676] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:46 2022] GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d => generated 1518 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:46.546595 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-4c1a36b8-b773-479e-bdba-193f17ae4673 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:46.555902 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-4c1a36b8-b773-479e-bdba-193f17ae4673 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:46.557403 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-4c1a36b8-b773-479e-bdba-193f17ae4673 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:46.558552 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-4c1a36b8-b773-479e-bdba-193f17ae4673 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 200 len: 1600 microversion: 2.20 time: 0.322270 Jun 16 19:04:46.559168 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 350/677] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:04:46 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 1600 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:04:46.577013 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-c19d0949-8f1f-47ef-8511-837884f5110f tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:46.577513 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-c19d0949-8f1f-47ef-8511-837884f5110f tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:46.583799 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-c19d0949-8f1f-47ef-8511-837884f5110f tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:46.584252 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-c19d0949-8f1f-47ef-8511-837884f5110f tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:46.585024 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-c19d0949-8f1f-47ef-8511-837884f5110f tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:46.585463 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-c19d0949-8f1f-47ef-8511-837884f5110f tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:46.667224 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-c19d0949-8f1f-47ef-8511-837884f5110f tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.094027 Jun 16 19:04:46.667820 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 328/678] 10.222.0.70 () {60 vars in 1315 bytes} [Thu Jun 16 19:04:46 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 19:04:47.195695 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [req-64baee4a-8178-41c7-a081-660648f29438 req-c588e8c5-d4ef-40a6-a74c-e87b16aa13ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4277200-c999-4c53-85de-b2a8b120cd6d", "name": "network-vif-unplugged", "status": "completed", "tag": "52aa00b3-538a-446a-8118-2c3fa72e640d"}]} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:04:47.211142 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-64baee4a-8178-41c7-a081-660648f29438 req-c588e8c5-d4ef-40a6-a74c-e87b16aa13ac service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:47.211592 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-64baee4a-8178-41c7-a081-660648f29438 req-c588e8c5-d4ef-40a6-a74c-e87b16aa13ac service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:47.224869 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.compute.server_external_events [req-64baee4a-8178-41c7-a081-660648f29438 req-c588e8c5-d4ef-40a6-a74c-e87b16aa13ac service nova] Unable to find a host for instance c4277200-c999-4c53-85de-b2a8b120cd6d. Dropping event network-vif-unplugged {{(pid=117852) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 16 19:04:47.225765 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [req-64baee4a-8178-41c7-a081-660648f29438 req-c588e8c5-d4ef-40a6-a74c-e87b16aa13ac service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.035726 Jun 16 19:04:47.227922 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 351/679] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 38 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 16 19:04:47.505453 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-036acafc-5df1-47b2-b9fa-41db3634ef35 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:47.506014 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-036acafc-5df1-47b2-b9fa-41db3634ef35 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] [instance: c4277200-c999-4c53-85de-b2a8b120cd6d] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:47.512264 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-036acafc-5df1-47b2-b9fa-41db3634ef35 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:47.512856 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-036acafc-5df1-47b2-b9fa-41db3634ef35 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:47.513638 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-036acafc-5df1-47b2-b9fa-41db3634ef35 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:47.514078 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-036acafc-5df1-47b2-b9fa-41db3634ef35 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:47.707992 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-712c4534-8800-4e1a-9b82-77cbefcb789d tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:47.711563 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-712c4534-8800-4e1a-9b82-77cbefcb789d tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] [instance: edce90bf-b3d6-49de-a45f-9b65e1759b51] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:47.720612 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:04:47.745880 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-712c4534-8800-4e1a-9b82-77cbefcb789d tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:47.747971 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-712c4534-8800-4e1a-9b82-77cbefcb789d tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:47.750209 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-712c4534-8800-4e1a-9b82-77cbefcb789d tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:47.750779 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-712c4534-8800-4e1a-9b82-77cbefcb789d tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:47.762260 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-036acafc-5df1-47b2-b9fa-41db3634ef35 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27db09b804fa426a83f103cf5dd116a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629634dc3dc54893b68cb9c9dc08505d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:47.788820 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-036acafc-5df1-47b2-b9fa-41db3634ef35 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] 10.222.0.70 "GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d" status: 200 len: 1518 microversion: 2.1 time: 0.289824 Jun 16 19:04:47.795713 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 329/680] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:47 2022] GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d => generated 1518 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:04:47.817646 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [req-bf932091-19f0-416f-9b5f-cc82b9e84ad4 req-93b39c1a-b6e5-4c72-afa9-b9848ea52f22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac8de877-3a07-4017-99fb-45b37ef123b6", "tag": "8bd9db24-3ac1-4beb-93fd-9cdfca791f22"}]} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:04:47.837094 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-bf932091-19f0-416f-9b5f-cc82b9e84ad4 req-93b39c1a-b6e5-4c72-afa9-b9848ea52f22 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:47.837560 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-bf932091-19f0-416f-9b5f-cc82b9e84ad4 req-93b39c1a-b6e5-4c72-afa9-b9848ea52f22 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:47.853275 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.compute.server_external_events [req-bf932091-19f0-416f-9b5f-cc82b9e84ad4 req-93b39c1a-b6e5-4c72-afa9-b9848ea52f22 service nova] Creating event network-changed:8bd9db24-3ac1-4beb-93fd-9cdfca791f22 for instance ac8de877-3a07-4017-99fb-45b37ef123b6 on hv-cinder-84617 Jun 16 19:04:47.865749 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [req-bf932091-19f0-416f-9b5f-cc82b9e84ad4 req-93b39c1a-b6e5-4c72-afa9-b9848ea52f22 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052498 Jun 16 19:04:47.869177 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 330/681] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:04:47.875428 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-8e6a3d02-b471-4d5a-a858-de69ffc143e8 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:47.876069 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-8e6a3d02-b471-4d5a-a858-de69ffc143e8 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] [instance: c771affd-c89b-412f-8ece-422ececa188a] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:47.899299 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-8e6a3d02-b471-4d5a-a858-de69ffc143e8 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:47.901546 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-8e6a3d02-b471-4d5a-a858-de69ffc143e8 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:47.906351 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-8e6a3d02-b471-4d5a-a858-de69ffc143e8 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:47.907161 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-8e6a3d02-b471-4d5a-a858-de69ffc143e8 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:47.939524 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.objects.instance [None req-712c4534-8800-4e1a-9b82-77cbefcb789d tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lazy-loading 'services' on Instance uuid edce90bf-b3d6-49de-a45f-9b65e1759b51 {{(pid=117852) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:04:47.991929 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-8e6a3d02-b471-4d5a-a858-de69ffc143e8 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] [instance: c771affd-c89b-412f-8ece-422ececa188a] Going to try to terminate instance {{(pid=117850) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:04:48.097306 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-712c4534-8800-4e1a-9b82-77cbefcb789d tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] 10.222.0.70 "DELETE /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51/os-volume_attachments/c5a2cd30-9742-4190-866d-9274217cfc27" status: 202 len: 0 microversion: 2.1 time: 0.394288 Jun 16 19:04:48.101354 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 352/682] 10.222.0.70 () {58 vars in 1415 bytes} [Thu Jun 16 19:04:47 2022] DELETE /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51/os-volume_attachments/c5a2cd30-9742-4190-866d-9274217cfc27 => generated 0 bytes in 400 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:04:48.113916 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [req-315778b6-93b1-44c1-ba25-18a3920a0984 req-d5710598-44a4-4c08-91b2-5ef1910fc524 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edce90bf-b3d6-49de-a45f-9b65e1759b51", "tag": "1ff09938-bf10-4206-8fd9-6a39acb93f8c"}]} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:04:48.129304 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-315778b6-93b1-44c1-ba25-18a3920a0984 req-d5710598-44a4-4c08-91b2-5ef1910fc524 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:48.130039 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-315778b6-93b1-44c1-ba25-18a3920a0984 req-d5710598-44a4-4c08-91b2-5ef1910fc524 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:48.152936 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.compute.server_external_events [req-315778b6-93b1-44c1-ba25-18a3920a0984 req-d5710598-44a4-4c08-91b2-5ef1910fc524 service nova] Creating event network-changed:1ff09938-bf10-4206-8fd9-6a39acb93f8c for instance edce90bf-b3d6-49de-a45f-9b65e1759b51 on hv-cinder-84617 Jun 16 19:04:48.159786 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [req-315778b6-93b1-44c1-ba25-18a3920a0984 req-d5710598-44a4-4c08-91b2-5ef1910fc524 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055367 Jun 16 19:04:48.161547 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 353/683] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:04:48.167433 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-be6d0e5a-14ee-4f64-b0c0-ce7ffe3584d9 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:48.168815 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-be6d0e5a-14ee-4f64-b0c0-ce7ffe3584d9 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] [instance: edce90bf-b3d6-49de-a45f-9b65e1759b51] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:48.178265 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-be6d0e5a-14ee-4f64-b0c0-ce7ffe3584d9 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:48.179100 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-be6d0e5a-14ee-4f64-b0c0-ce7ffe3584d9 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:48.180654 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-be6d0e5a-14ee-4f64-b0c0-ce7ffe3584d9 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:48.181016 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-be6d0e5a-14ee-4f64-b0c0-ce7ffe3584d9 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:48.193444 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-8e6a3d02-b471-4d5a-a858-de69ffc143e8 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] 10.222.0.70 "DELETE /compute/v2.1/servers/c771affd-c89b-412f-8ece-422ececa188a" status: 204 len: 0 microversion: 2.1 time: 0.319608 Jun 16 19:04:48.197401 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 331/684] 10.222.0.70 () {58 vars in 1238 bytes} [Thu Jun 16 19:04:47 2022] DELETE /compute/v2.1/servers/c771affd-c89b-412f-8ece-422ececa188a => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:04:48.214778 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-be9bff41-d1a2-438d-9be7-a2ddc88f4c85 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:48.215779 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-be9bff41-d1a2-438d-9be7-a2ddc88f4c85 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] [instance: c771affd-c89b-412f-8ece-422ececa188a] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:48.223524 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-be9bff41-d1a2-438d-9be7-a2ddc88f4c85 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:48.224314 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-be9bff41-d1a2-438d-9be7-a2ddc88f4c85 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:48.225223 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-be9bff41-d1a2-438d-9be7-a2ddc88f4c85 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:48.226216 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-be9bff41-d1a2-438d-9be7-a2ddc88f4c85 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:48.238513 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-be6d0e5a-14ee-4f64-b0c0-ce7ffe3584d9 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] 10.222.0.70 "GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075237 Jun 16 19:04:48.243669 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 354/685] 10.222.0.70 () {58 vars in 1301 bytes} [Thu Jun 16 19:04:48 2022] GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:04:48.252983 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 19:04:48.253611 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Thu Jun 16 19:04:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c771affd-c89b-412f-8ece-422ececa188a (ip 10.222.0.70) !!! Jun 16 19:04:48.387173 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-be9bff41-d1a2-438d-9be7-a2ddc88f4c85 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb08a57a393d4c8591da42cd5e92aca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c879d7f44189ab76e377c33f5e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:48.396922 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-be9bff41-d1a2-438d-9be7-a2ddc88f4c85 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] 10.222.0.70 "GET /compute/v2.1/servers/c771affd-c89b-412f-8ece-422ececa188a" status: 200 len: 1515 microversion: 2.1 time: 0.193532 Jun 16 19:04:48.397818 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 332/686] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:48 2022] GET /compute/v2.1/servers/c771affd-c89b-412f-8ece-422ececa188a => generated 1515 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:04:48.812884 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-8a5117d9-f986-4325-b4e7-734d79808793 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:48.813846 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-8a5117d9-f986-4325-b4e7-734d79808793 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] [instance: c4277200-c999-4c53-85de-b2a8b120cd6d] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:48.820619 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-8a5117d9-f986-4325-b4e7-734d79808793 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:48.821253 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-8a5117d9-f986-4325-b4e7-734d79808793 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:48.822211 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-8a5117d9-f986-4325-b4e7-734d79808793 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:48.822760 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-8a5117d9-f986-4325-b4e7-734d79808793 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:48.976350 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-8a5117d9-f986-4325-b4e7-734d79808793 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27db09b804fa426a83f103cf5dd116a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629634dc3dc54893b68cb9c9dc08505d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:48.985171 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-8a5117d9-f986-4325-b4e7-734d79808793 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] 10.222.0.70 "GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d" status: 200 len: 1574 microversion: 2.1 time: 0.176477 Jun 16 19:04:48.986110 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 355/687] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:48 2022] GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d => generated 1574 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:49.255489 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-8adacf83-2c20-4ffe-ab15-ba5cea6be72c tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:49.256497 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-8adacf83-2c20-4ffe-ab15-ba5cea6be72c tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] [instance: edce90bf-b3d6-49de-a45f-9b65e1759b51] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:49.263091 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-8adacf83-2c20-4ffe-ab15-ba5cea6be72c tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:49.263537 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-8adacf83-2c20-4ffe-ab15-ba5cea6be72c tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:49.264289 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-8adacf83-2c20-4ffe-ab15-ba5cea6be72c tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:49.264725 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-8adacf83-2c20-4ffe-ab15-ba5cea6be72c tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:49.294055 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-8adacf83-2c20-4ffe-ab15-ba5cea6be72c tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] 10.222.0.70 "GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043264 Jun 16 19:04:49.294625 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 333/688] 10.222.0.70 () {58 vars in 1301 bytes} [Thu Jun 16 19:04:49 2022] GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:04:49.414999 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-87633e5b-03fc-441a-8295-dd0bdf2671fd tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:49.415518 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-87633e5b-03fc-441a-8295-dd0bdf2671fd tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] [instance: c771affd-c89b-412f-8ece-422ececa188a] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:49.421867 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-87633e5b-03fc-441a-8295-dd0bdf2671fd tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:49.422342 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-87633e5b-03fc-441a-8295-dd0bdf2671fd tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:49.423126 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-87633e5b-03fc-441a-8295-dd0bdf2671fd tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:49.423560 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-87633e5b-03fc-441a-8295-dd0bdf2671fd tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:49.556072 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-87633e5b-03fc-441a-8295-dd0bdf2671fd tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb08a57a393d4c8591da42cd5e92aca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c879d7f44189ab76e377c33f5e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:49.563889 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-87633e5b-03fc-441a-8295-dd0bdf2671fd tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] 10.222.0.70 "GET /compute/v2.1/servers/c771affd-c89b-412f-8ece-422ececa188a" status: 200 len: 1515 microversion: 2.1 time: 0.152853 Jun 16 19:04:49.564489 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 356/689] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:49 2022] GET /compute/v2.1/servers/c771affd-c89b-412f-8ece-422ececa188a => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:50.002445 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-e9b11171-86d7-4142-8841-672c4952ce38 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:50.003097 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-e9b11171-86d7-4142-8841-672c4952ce38 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] [instance: c4277200-c999-4c53-85de-b2a8b120cd6d] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:50.009435 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-e9b11171-86d7-4142-8841-672c4952ce38 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:50.009873 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-e9b11171-86d7-4142-8841-672c4952ce38 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:50.010677 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-e9b11171-86d7-4142-8841-672c4952ce38 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:50.011115 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-e9b11171-86d7-4142-8841-672c4952ce38 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:50.144002 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-e9b11171-86d7-4142-8841-672c4952ce38 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27db09b804fa426a83f103cf5dd116a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629634dc3dc54893b68cb9c9dc08505d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:50.152091 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-e9b11171-86d7-4142-8841-672c4952ce38 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] 10.222.0.70 "GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d" status: 200 len: 1574 microversion: 2.1 time: 0.153468 Jun 16 19:04:50.152661 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 334/690] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:49 2022] GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:04:50.306009 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-3897822c-3768-4447-9a4c-8e01d365abf5 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:50.307016 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-3897822c-3768-4447-9a4c-8e01d365abf5 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] [instance: edce90bf-b3d6-49de-a45f-9b65e1759b51] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:50.313127 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-3897822c-3768-4447-9a4c-8e01d365abf5 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:50.313582 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-3897822c-3768-4447-9a4c-8e01d365abf5 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:50.314349 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-3897822c-3768-4447-9a4c-8e01d365abf5 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:50.314821 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-3897822c-3768-4447-9a4c-8e01d365abf5 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:50.343297 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-3897822c-3768-4447-9a4c-8e01d365abf5 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] 10.222.0.70 "GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041296 Jun 16 19:04:50.343855 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 357/691] 10.222.0.70 () {58 vars in 1301 bytes} [Thu Jun 16 19:04:50 2022] GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:04:50.581938 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-d3261b0f-a082-447b-9bc7-8f48bd347f59 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:50.582494 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-d3261b0f-a082-447b-9bc7-8f48bd347f59 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] [instance: c771affd-c89b-412f-8ece-422ececa188a] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:50.585148 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:04:50.590475 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d3261b0f-a082-447b-9bc7-8f48bd347f59 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:50.590950 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d3261b0f-a082-447b-9bc7-8f48bd347f59 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:50.591710 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d3261b0f-a082-447b-9bc7-8f48bd347f59 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:50.592144 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d3261b0f-a082-447b-9bc7-8f48bd347f59 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:50.731061 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-d3261b0f-a082-447b-9bc7-8f48bd347f59 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb08a57a393d4c8591da42cd5e92aca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c879d7f44189ab76e377c33f5e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:50.738937 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-d3261b0f-a082-447b-9bc7-8f48bd347f59 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] 10.222.0.70 "GET /compute/v2.1/servers/c771affd-c89b-412f-8ece-422ececa188a" status: 200 len: 1515 microversion: 2.1 time: 0.161114 Jun 16 19:04:50.739505 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 335/692] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:50 2022] GET /compute/v2.1/servers/c771affd-c89b-412f-8ece-422ececa188a => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:51.176085 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-b4c9553d-c707-4a6d-b838-9cff98fc0f20 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:51.176828 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-b4c9553d-c707-4a6d-b838-9cff98fc0f20 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] [instance: c4277200-c999-4c53-85de-b2a8b120cd6d] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:51.184875 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-b4c9553d-c707-4a6d-b838-9cff98fc0f20 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:51.185325 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-b4c9553d-c707-4a6d-b838-9cff98fc0f20 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:51.186110 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-b4c9553d-c707-4a6d-b838-9cff98fc0f20 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:51.186542 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-b4c9553d-c707-4a6d-b838-9cff98fc0f20 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:51.356894 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-af4339b2-11d5-4ed5-98c6-5aa206545517 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:51.357879 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-af4339b2-11d5-4ed5-98c6-5aa206545517 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] [instance: edce90bf-b3d6-49de-a45f-9b65e1759b51] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:51.368542 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-af4339b2-11d5-4ed5-98c6-5aa206545517 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:51.369403 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-af4339b2-11d5-4ed5-98c6-5aa206545517 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:51.370467 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-af4339b2-11d5-4ed5-98c6-5aa206545517 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:51.370993 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-af4339b2-11d5-4ed5-98c6-5aa206545517 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:51.411433 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-af4339b2-11d5-4ed5-98c6-5aa206545517 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] 10.222.0.70 "GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059421 Jun 16 19:04:51.412666 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 336/693] 10.222.0.70 () {58 vars in 1301 bytes} [Thu Jun 16 19:04:51 2022] GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 19:04:51.424818 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-682ed61a-07df-42c3-9ad5-f2e590961543 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:51.426418 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-682ed61a-07df-42c3-9ad5-f2e590961543 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] [instance: edce90bf-b3d6-49de-a45f-9b65e1759b51] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:51.433612 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-682ed61a-07df-42c3-9ad5-f2e590961543 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:51.434074 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-682ed61a-07df-42c3-9ad5-f2e590961543 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:51.434900 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-682ed61a-07df-42c3-9ad5-f2e590961543 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:51.435342 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-682ed61a-07df-42c3-9ad5-f2e590961543 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:51.535928 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.wsgi [None req-682ed61a-07df-42c3-9ad5-f2e590961543 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] HTTP exception thrown: Instance edce90bf-b3d6-49de-a45f-9b65e1759b51 is not attached to volume c5a2cd30-9742-4190-866d-9274217cfc27 Jun 16 19:04:51.542018 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-682ed61a-07df-42c3-9ad5-f2e590961543 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Request method failure captured: Jun 16 19:04:51.542018 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: request: DELETE /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51/os-volume_attachments/c5a2cd30-9742-4190-866d-9274217cfc27 HTTP/1.1 Jun 16 19:04:51.542018 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Accept: application/json Jun 16 19:04:51.542018 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Accept-Encoding: identity Jun 16 19:04:51.542018 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Connection: close Jun 16 19:04:51.542018 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Content-Length: 0 Jun 16 19:04:51.542018 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Content-Type: application/json Jun 16 19:04:51.542018 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Host: 10.222.0.70 Jun 16 19:04:51.542018 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Openstack-System-Scope: None Jun 16 19:04:51.542018 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: User-Agent: python-urllib3/1.26.9 Jun 16 19:04:51.542018 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Auth-Token: gAAAAABiq33teS2OqFSYP1psKNWWdzfpaJt8TYZPFUEnKK8Y6DM7Q-2AX08ii-pGiMmNNjWJonM33ZcfEzX-84OGvSrAXKgVuNWbwT4OI6L0UT-7MLXXMkmmbADcY_wUw10EK_VcSn2aeqVrjev8yjqJxgHL-uQDtezM01LiXH7PP-f1Ht-WSHo Jun 16 19:04:51.542018 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Domain-Id: None Jun 16 19:04:51.542018 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Domain-Name: None Jun 16 19:04:51.542018 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Identity-Status: Confirmed Jun 16 19:04:51.542018 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Is-Admin-Project: True Jun 16 19:04:51.542018 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Domain-Id: default Jun 16 19:04:51.542018 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Domain-Name: Default Jun 16 19:04:51.542018 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Id: 741ee13164894b49be1a0fc6c1385a8e Jun 16 19:04:51.542018 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Name: tempest-TestMinimumBasicScenario-1766193046 Jun 16 19:04:51.542018 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Role: member,reader Jun 16 19:04:51.542018 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Roles: member,reader Jun 16 19:04:51.543552 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/741ee13164894b49be1a0fc6c1385a8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_741ee13164894b49be1a0fc6c1385a8e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/741ee13164894b49be1a0fc6c1385a8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/741ee13164894b49be1a0fc6c1385a8e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 16 19:04:51.543552 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant: tempest-TestMinimumBasicScenario-1766193046 Jun 16 19:04:51.543552 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant-Id: 741ee13164894b49be1a0fc6c1385a8e Jun 16 19:04:51.543552 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1766193046 Jun 16 19:04:51.543552 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User: tempest-TestMinimumBasicScenario-1766193046-project Jun 16 19:04:51.543552 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Domain-Id: default Jun 16 19:04:51.543552 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Domain-Name: Default Jun 16 19:04:51.543552 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Id: 047e841cefdd4975947b2c154412953b Jun 16 19:04:51.543552 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Name: tempest-TestMinimumBasicScenario-1766193046-project Jun 16 19:04:51.543552 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: method: > Jun 16 19:04:51.543552 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: exception: Instance edce90bf-b3d6-49de-a45f-9b65e1759b51 is not attached to volume c5a2cd30-9742-4190-866d-9274217cfc27 Jun 16 19:04:51.547912 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: action_args: {'server_id': 'edce90bf-b3d6-49de-a45f-9b65e1759b51', 'id': 'c5a2cd30-9742-4190-866d-9274217cfc27'} Jun 16 19:04:51.547912 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:04:51.547912 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:04:51.547912 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 16 19:04:51.547912 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 16 19:04:51.547912 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 19:04:51.547912 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 19:04:51.547912 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 16 19:04:51.547912 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 16 19:04:51.547912 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id c5a2cd30-9742-4190-866d-9274217cfc27. Jun 16 19:04:51.547912 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:04:51.547912 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:04:51.547912 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:04:51.547912 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:04:51.547912 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:04:51.547912 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:04:51.547912 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:04:51.547912 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:04:51.547912 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:04:51.549348 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:04:51.549348 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 16 19:04:51.549348 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 16 19:04:51.549348 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edce90bf-b3d6-49de-a45f-9b65e1759b51 is not attached to volume c5a2cd30-9742-4190-866d-9274217cfc27 Jun 16 19:04:51.549348 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:04:51.549348 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:04:51.549348 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:04:51.549348 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:04:51.549348 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:04:51.549348 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:04:51.549348 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:04:51.549348 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:04:51.549348 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edce90bf-b3d6-49de-a45f-9b65e1759b51 is not attached to volume c5a2cd30-9742-4190-866d-9274217cfc27 Jun 16 19:04:51.549348 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:04:51.549348 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-682ed61a-07df-42c3-9ad5-f2e590961543 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Returning 404 to user: Instance edce90bf-b3d6-49de-a45f-9b65e1759b51 is not attached to volume c5a2cd30-9742-4190-866d-9274217cfc27 {{(pid=117850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:04:51.550907 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-682ed61a-07df-42c3-9ad5-f2e590961543 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] 10.222.0.70 "DELETE /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51/os-volume_attachments/c5a2cd30-9742-4190-866d-9274217cfc27" status: 404 len: 154 microversion: 2.1 time: 0.123879 Jun 16 19:04:51.550907 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 337/694] 10.222.0.70 () {58 vars in 1415 bytes} [Thu Jun 16 19:04:51 2022] DELETE /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51/os-volume_attachments/c5a2cd30-9742-4190-866d-9274217cfc27 => generated 154 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:04:51.747238 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-b4c9553d-c707-4a6d-b838-9cff98fc0f20 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27db09b804fa426a83f103cf5dd116a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629634dc3dc54893b68cb9c9dc08505d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:51.753955 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:04:51.760844 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-b4c9553d-c707-4a6d-b838-9cff98fc0f20 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] 10.222.0.70 "GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d" status: 200 len: 1574 microversion: 2.1 time: 0.595162 Jun 16 19:04:51.761082 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-393528d8-03f2-460c-bd5a-be67cf62f982 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:51.761921 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 358/695] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:51 2022] GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d => generated 1574 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:51.763241 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-393528d8-03f2-460c-bd5a-be67cf62f982 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] [instance: c771affd-c89b-412f-8ece-422ececa188a] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:51.776634 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-393528d8-03f2-460c-bd5a-be67cf62f982 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:51.777773 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-393528d8-03f2-460c-bd5a-be67cf62f982 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:51.778881 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-393528d8-03f2-460c-bd5a-be67cf62f982 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:51.779483 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-393528d8-03f2-460c-bd5a-be67cf62f982 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:51.807485 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:04:52.199698 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-393528d8-03f2-460c-bd5a-be67cf62f982 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb08a57a393d4c8591da42cd5e92aca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c879d7f44189ab76e377c33f5e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:52.208507 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-393528d8-03f2-460c-bd5a-be67cf62f982 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] 10.222.0.70 "GET /compute/v2.1/servers/c771affd-c89b-412f-8ece-422ececa188a" status: 200 len: 1515 microversion: 2.1 time: 0.455750 Jun 16 19:04:52.209177 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 338/696] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:51 2022] GET /compute/v2.1/servers/c771affd-c89b-412f-8ece-422ececa188a => generated 1515 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:52.557743 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [req-0ea9c5e7-be95-4d58-90b6-f589f4223aff req-0f9ca1a2-013d-4fa5-9015-d6e12ef32bc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c771affd-c89b-412f-8ece-422ececa188a", "name": "network-vif-deleted", "tag": "eec4caa0-3777-4a01-a5e8-4be5c8c1f8c9"}]} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:04:52.567595 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-0ea9c5e7-be95-4d58-90b6-f589f4223aff req-0f9ca1a2-013d-4fa5-9015-d6e12ef32bc4 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:52.568039 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-0ea9c5e7-be95-4d58-90b6-f589f4223aff req-0f9ca1a2-013d-4fa5-9015-d6e12ef32bc4 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:52.578776 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.compute.server_external_events [req-0ea9c5e7-be95-4d58-90b6-f589f4223aff req-0f9ca1a2-013d-4fa5-9015-d6e12ef32bc4 service nova] Creating event network-vif-deleted:eec4caa0-3777-4a01-a5e8-4be5c8c1f8c9 for instance c771affd-c89b-412f-8ece-422ececa188a on hv-cinder-84617 Jun 16 19:04:52.584000 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [req-0ea9c5e7-be95-4d58-90b6-f589f4223aff req-0f9ca1a2-013d-4fa5-9015-d6e12ef32bc4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106150 Jun 16 19:04:52.584576 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 359/697] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:04:52.723050 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-c1b7726e-dab2-4799-84b2-6f0419b4a400 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:52.723566 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-c1b7726e-dab2-4799-84b2-6f0419b4a400 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] [instance: edce90bf-b3d6-49de-a45f-9b65e1759b51] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:52.730039 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-c1b7726e-dab2-4799-84b2-6f0419b4a400 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:52.730498 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-c1b7726e-dab2-4799-84b2-6f0419b4a400 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:52.731307 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-c1b7726e-dab2-4799-84b2-6f0419b4a400 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:52.731750 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-c1b7726e-dab2-4799-84b2-6f0419b4a400 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:52.757624 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-c1b7726e-dab2-4799-84b2-6f0419b4a400 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] [instance: edce90bf-b3d6-49de-a45f-9b65e1759b51] Going to try to terminate instance {{(pid=117850) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:04:52.779359 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-5f88581b-fa56-4c83-a8ea-1ec9072b7214 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:52.780070 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-5f88581b-fa56-4c83-a8ea-1ec9072b7214 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] [instance: c4277200-c999-4c53-85de-b2a8b120cd6d] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:52.786799 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-5f88581b-fa56-4c83-a8ea-1ec9072b7214 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:52.787251 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-5f88581b-fa56-4c83-a8ea-1ec9072b7214 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:52.788018 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-5f88581b-fa56-4c83-a8ea-1ec9072b7214 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:52.788451 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-5f88581b-fa56-4c83-a8ea-1ec9072b7214 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:52.833497 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-c1b7726e-dab2-4799-84b2-6f0419b4a400 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] 10.222.0.70 "DELETE /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51" status: 204 len: 0 microversion: 2.1 time: 0.114207 Jun 16 19:04:52.834075 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 339/698] 10.222.0.70 () {58 vars in 1238 bytes} [Thu Jun 16 19:04:52 2022] DELETE /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:04:52.842603 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-c61e230e-48cc-4085-8544-44f6f65f16f2 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:52.843317 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-c61e230e-48cc-4085-8544-44f6f65f16f2 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] [instance: edce90bf-b3d6-49de-a45f-9b65e1759b51] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:52.849708 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-c61e230e-48cc-4085-8544-44f6f65f16f2 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:52.850155 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-c61e230e-48cc-4085-8544-44f6f65f16f2 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:52.850948 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-c61e230e-48cc-4085-8544-44f6f65f16f2 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:52.851383 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-c61e230e-48cc-4085-8544-44f6f65f16f2 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:52.932868 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-5f88581b-fa56-4c83-a8ea-1ec9072b7214 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27db09b804fa426a83f103cf5dd116a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629634dc3dc54893b68cb9c9dc08505d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:52.940826 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-5f88581b-fa56-4c83-a8ea-1ec9072b7214 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] 10.222.0.70 "GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d" status: 200 len: 1574 microversion: 2.1 time: 0.165831 Jun 16 19:04:52.942611 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 360/699] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:52 2022] GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d => generated 1574 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:04:52.992320 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-c61e230e-48cc-4085-8544-44f6f65f16f2 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047e841cefdd4975947b2c154412953b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741ee13164894b49be1a0fc6c1385a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:52.999842 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-c61e230e-48cc-4085-8544-44f6f65f16f2 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] 10.222.0.70 "GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51" status: 200 len: 1555 microversion: 2.1 time: 0.161352 Jun 16 19:04:53.000430 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 340/700] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:52 2022] GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51 => generated 1555 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:53.226430 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-98ec2119-8766-400e-9656-2cd36e57a2a0 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:53.227096 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-98ec2119-8766-400e-9656-2cd36e57a2a0 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] [instance: c771affd-c89b-412f-8ece-422ececa188a] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:53.233100 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-98ec2119-8766-400e-9656-2cd36e57a2a0 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:53.233553 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-98ec2119-8766-400e-9656-2cd36e57a2a0 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:53.234305 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-98ec2119-8766-400e-9656-2cd36e57a2a0 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:53.234782 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-98ec2119-8766-400e-9656-2cd36e57a2a0 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:53.265460 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-98ec2119-8766-400e-9656-2cd36e57a2a0 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:53.265829 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-98ec2119-8766-400e-9656-2cd36e57a2a0 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:53.266276 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.objects.instance [None req-98ec2119-8766-400e-9656-2cd36e57a2a0 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lazy-loading 'fault' on Instance uuid c771affd-c89b-412f-8ece-422ececa188a {{(pid=117852) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:04:53.309243 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-98ec2119-8766-400e-9656-2cd36e57a2a0 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb08a57a393d4c8591da42cd5e92aca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c879d7f44189ab76e377c33f5e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:53.317445 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-98ec2119-8766-400e-9656-2cd36e57a2a0 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] 10.222.0.70 "GET /compute/v2.1/servers/c771affd-c89b-412f-8ece-422ececa188a" status: 200 len: 1309 microversion: 2.1 time: 0.095438 Jun 16 19:04:53.318459 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 361/701] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:53 2022] GET /compute/v2.1/servers/c771affd-c89b-412f-8ece-422ececa188a => generated 1309 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:53.962011 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-bf5498b7-ee24-4df2-a70e-6d318cc90103 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:53.962723 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-bf5498b7-ee24-4df2-a70e-6d318cc90103 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] [instance: c4277200-c999-4c53-85de-b2a8b120cd6d] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:53.969288 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-bf5498b7-ee24-4df2-a70e-6d318cc90103 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:53.969742 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-bf5498b7-ee24-4df2-a70e-6d318cc90103 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:53.970510 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-bf5498b7-ee24-4df2-a70e-6d318cc90103 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:53.970981 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-bf5498b7-ee24-4df2-a70e-6d318cc90103 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:54.016955 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-efd825e1-f71c-4d0c-9cc5-8e45f3cc0c6c tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:54.017584 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-efd825e1-f71c-4d0c-9cc5-8e45f3cc0c6c tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] [instance: edce90bf-b3d6-49de-a45f-9b65e1759b51] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:54.026113 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-efd825e1-f71c-4d0c-9cc5-8e45f3cc0c6c tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:54.026619 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-efd825e1-f71c-4d0c-9cc5-8e45f3cc0c6c tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:54.027418 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-efd825e1-f71c-4d0c-9cc5-8e45f3cc0c6c tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:54.027861 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-efd825e1-f71c-4d0c-9cc5-8e45f3cc0c6c tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:54.121415 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-bf5498b7-ee24-4df2-a70e-6d318cc90103 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27db09b804fa426a83f103cf5dd116a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629634dc3dc54893b68cb9c9dc08505d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:54.129751 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-bf5498b7-ee24-4df2-a70e-6d318cc90103 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] 10.222.0.70 "GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d" status: 200 len: 1574 microversion: 2.1 time: 0.171562 Jun 16 19:04:54.130319 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 341/702] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:53 2022] GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d => generated 1574 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:54.167236 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-efd825e1-f71c-4d0c-9cc5-8e45f3cc0c6c tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047e841cefdd4975947b2c154412953b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741ee13164894b49be1a0fc6c1385a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:54.174813 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-efd825e1-f71c-4d0c-9cc5-8e45f3cc0c6c tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] 10.222.0.70 "GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51" status: 200 len: 1555 microversion: 2.1 time: 0.161720 Jun 16 19:04:54.176678 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 362/703] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:54 2022] GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51 => generated 1555 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:04:54.335330 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-d9586141-828b-4752-b9b5-2a6ddf86c303 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:54.335868 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-d9586141-828b-4752-b9b5-2a6ddf86c303 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] [instance: c771affd-c89b-412f-8ece-422ececa188a] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:54.341915 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d9586141-828b-4752-b9b5-2a6ddf86c303 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:54.342366 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d9586141-828b-4752-b9b5-2a6ddf86c303 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:54.343165 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d9586141-828b-4752-b9b5-2a6ddf86c303 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:54.343607 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d9586141-828b-4752-b9b5-2a6ddf86c303 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:54.374828 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d9586141-828b-4752-b9b5-2a6ddf86c303 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:54.375274 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d9586141-828b-4752-b9b5-2a6ddf86c303 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:54.375718 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.objects.instance [None req-d9586141-828b-4752-b9b5-2a6ddf86c303 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lazy-loading 'fault' on Instance uuid c771affd-c89b-412f-8ece-422ececa188a {{(pid=117850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:04:54.417514 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-d9586141-828b-4752-b9b5-2a6ddf86c303 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb08a57a393d4c8591da42cd5e92aca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c879d7f44189ab76e377c33f5e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:54.424884 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-d9586141-828b-4752-b9b5-2a6ddf86c303 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] 10.222.0.70 "GET /compute/v2.1/servers/c771affd-c89b-412f-8ece-422ececa188a" status: 200 len: 1309 microversion: 2.1 time: 0.093628 Jun 16 19:04:54.426336 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 342/704] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:54 2022] GET /compute/v2.1/servers/c771affd-c89b-412f-8ece-422ececa188a => generated 1309 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:55.146793 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-116b4faa-48dc-41eb-95d6-49d6ecf6c52b tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:55.147405 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-116b4faa-48dc-41eb-95d6-49d6ecf6c52b tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] [instance: c4277200-c999-4c53-85de-b2a8b120cd6d] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:55.154529 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-116b4faa-48dc-41eb-95d6-49d6ecf6c52b tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:55.154741 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-116b4faa-48dc-41eb-95d6-49d6ecf6c52b tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:55.156879 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-116b4faa-48dc-41eb-95d6-49d6ecf6c52b tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:55.157948 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-116b4faa-48dc-41eb-95d6-49d6ecf6c52b tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:55.193552 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-8c5676f4-e924-4792-8fbd-5bd4a27489b5 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:55.194725 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-8c5676f4-e924-4792-8fbd-5bd4a27489b5 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] [instance: edce90bf-b3d6-49de-a45f-9b65e1759b51] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:55.201625 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-8c5676f4-e924-4792-8fbd-5bd4a27489b5 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:55.202092 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-8c5676f4-e924-4792-8fbd-5bd4a27489b5 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:55.202904 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-8c5676f4-e924-4792-8fbd-5bd4a27489b5 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:55.203346 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-8c5676f4-e924-4792-8fbd-5bd4a27489b5 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:55.295235 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-116b4faa-48dc-41eb-95d6-49d6ecf6c52b tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27db09b804fa426a83f103cf5dd116a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629634dc3dc54893b68cb9c9dc08505d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:55.303399 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-116b4faa-48dc-41eb-95d6-49d6ecf6c52b tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] 10.222.0.70 "GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d" status: 200 len: 1574 microversion: 2.1 time: 0.161596 Jun 16 19:04:55.304067 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 363/705] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:55 2022] GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:55.340481 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-8c5676f4-e924-4792-8fbd-5bd4a27489b5 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047e841cefdd4975947b2c154412953b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741ee13164894b49be1a0fc6c1385a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:55.348702 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-8c5676f4-e924-4792-8fbd-5bd4a27489b5 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] 10.222.0.70 "GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51" status: 200 len: 1555 microversion: 2.1 time: 0.160258 Jun 16 19:04:55.349272 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 343/706] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:55 2022] GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51 => generated 1555 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:55.443864 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-2cd0226c-5996-4b66-b921-3ab9d02532e1 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:55.444692 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-2cd0226c-5996-4b66-b921-3ab9d02532e1 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] [instance: c771affd-c89b-412f-8ece-422ececa188a] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:55.450785 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-2cd0226c-5996-4b66-b921-3ab9d02532e1 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:55.451235 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-2cd0226c-5996-4b66-b921-3ab9d02532e1 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:55.452148 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-2cd0226c-5996-4b66-b921-3ab9d02532e1 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:55.452525 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-2cd0226c-5996-4b66-b921-3ab9d02532e1 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:55.485778 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-2cd0226c-5996-4b66-b921-3ab9d02532e1 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:55.486229 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-2cd0226c-5996-4b66-b921-3ab9d02532e1 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:55.486709 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.objects.instance [None req-2cd0226c-5996-4b66-b921-3ab9d02532e1 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lazy-loading 'fault' on Instance uuid c771affd-c89b-412f-8ece-422ececa188a {{(pid=117852) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:04:55.532844 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-2cd0226c-5996-4b66-b921-3ab9d02532e1 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb08a57a393d4c8591da42cd5e92aca9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb2c879d7f44189ab76e377c33f5e35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:55.539677 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-2cd0226c-5996-4b66-b921-3ab9d02532e1 tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] 10.222.0.70 "GET /compute/v2.1/servers/c771affd-c89b-412f-8ece-422ececa188a" status: 200 len: 1309 microversion: 2.1 time: 0.101100 Jun 16 19:04:55.540246 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 364/707] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:55 2022] GET /compute/v2.1/servers/c771affd-c89b-412f-8ece-422ececa188a => generated 1309 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:55.898470 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [req-5a6cb548-03b5-44c8-ac08-8834566febe1 req-928f0f4e-3d2b-4a4d-acf5-c7372cdb719d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edce90bf-b3d6-49de-a45f-9b65e1759b51", "name": "network-vif-deleted", "tag": "1ff09938-bf10-4206-8fd9-6a39acb93f8c"}]} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:04:55.908721 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-5a6cb548-03b5-44c8-ac08-8834566febe1 req-928f0f4e-3d2b-4a4d-acf5-c7372cdb719d service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:55.910184 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-5a6cb548-03b5-44c8-ac08-8834566febe1 req-928f0f4e-3d2b-4a4d-acf5-c7372cdb719d service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:55.923040 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.compute.server_external_events [req-5a6cb548-03b5-44c8-ac08-8834566febe1 req-928f0f4e-3d2b-4a4d-acf5-c7372cdb719d service nova] Creating event network-vif-deleted:1ff09938-bf10-4206-8fd9-6a39acb93f8c for instance edce90bf-b3d6-49de-a45f-9b65e1759b51 on hv-cinder-84617 Jun 16 19:04:55.929474 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [req-5a6cb548-03b5-44c8-ac08-8834566febe1 req-928f0f4e-3d2b-4a4d-acf5-c7372cdb719d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035188 Jun 16 19:04:55.930123 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 344/708] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:04:56.320720 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-40001ddb-d54c-4664-9a14-92a3687323d7 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:56.321483 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-40001ddb-d54c-4664-9a14-92a3687323d7 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] [instance: c4277200-c999-4c53-85de-b2a8b120cd6d] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:56.327956 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-40001ddb-d54c-4664-9a14-92a3687323d7 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:56.328409 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-40001ddb-d54c-4664-9a14-92a3687323d7 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:56.329174 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-40001ddb-d54c-4664-9a14-92a3687323d7 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:56.329612 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-40001ddb-d54c-4664-9a14-92a3687323d7 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:56.367450 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-8e910be4-70bd-4b79-8145-e00f54501149 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:56.368909 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-8e910be4-70bd-4b79-8145-e00f54501149 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] [instance: edce90bf-b3d6-49de-a45f-9b65e1759b51] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:56.376153 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-8e910be4-70bd-4b79-8145-e00f54501149 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:56.376675 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-8e910be4-70bd-4b79-8145-e00f54501149 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:56.377491 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-8e910be4-70bd-4b79-8145-e00f54501149 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:56.378171 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-8e910be4-70bd-4b79-8145-e00f54501149 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:56.415460 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-8e910be4-70bd-4b79-8145-e00f54501149 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:56.415978 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-8e910be4-70bd-4b79-8145-e00f54501149 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:56.416450 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.objects.instance [None req-8e910be4-70bd-4b79-8145-e00f54501149 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lazy-loading 'fault' on Instance uuid edce90bf-b3d6-49de-a45f-9b65e1759b51 {{(pid=117850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:04:56.479921 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-8e910be4-70bd-4b79-8145-e00f54501149 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '047e841cefdd4975947b2c154412953b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741ee13164894b49be1a0fc6c1385a8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:56.481290 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-40001ddb-d54c-4664-9a14-92a3687323d7 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27db09b804fa426a83f103cf5dd116a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629634dc3dc54893b68cb9c9dc08505d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:56.491291 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-40001ddb-d54c-4664-9a14-92a3687323d7 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] 10.222.0.70 "GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d" status: 200 len: 1574 microversion: 2.1 time: 0.174321 Jun 16 19:04:56.491542 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-8e910be4-70bd-4b79-8145-e00f54501149 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] 10.222.0.70 "GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51" status: 200 len: 1349 microversion: 2.1 time: 0.129629 Jun 16 19:04:56.491967 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 345/709] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:56 2022] GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51 => generated 1349 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:04:56.500796 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 365/710] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:56 2022] GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d => generated 1574 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:56.557255 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-6211e522-1880-4576-9564-f7d3a0bce8cb tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:56.557879 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-6211e522-1880-4576-9564-f7d3a0bce8cb tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] [instance: c771affd-c89b-412f-8ece-422ececa188a] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:56.563998 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-6211e522-1880-4576-9564-f7d3a0bce8cb tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:56.564457 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-6211e522-1880-4576-9564-f7d3a0bce8cb tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:56.565219 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-6211e522-1880-4576-9564-f7d3a0bce8cb tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:56.566443 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-6211e522-1880-4576-9564-f7d3a0bce8cb tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:56.579777 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.wsgi [None req-6211e522-1880-4576-9564-f7d3a0bce8cb tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] HTTP exception thrown: Instance c771affd-c89b-412f-8ece-422ececa188a could not be found. Jun 16 19:04:56.581514 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-6211e522-1880-4576-9564-f7d3a0bce8cb tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Request method failure captured: Jun 16 19:04:56.581514 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: request: GET /compute/v2.1/servers/c771affd-c89b-412f-8ece-422ececa188a HTTP/1.1 Jun 16 19:04:56.581514 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Accept: application/json Jun 16 19:04:56.581514 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Accept-Encoding: identity Jun 16 19:04:56.581514 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Connection: close Jun 16 19:04:56.581514 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Content-Length: 0 Jun 16 19:04:56.581514 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Content-Type: application/json Jun 16 19:04:56.581514 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Host: 10.222.0.70 Jun 16 19:04:56.581514 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Openstack-System-Scope: None Jun 16 19:04:56.581514 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: User-Agent: python-urllib3/1.26.9 Jun 16 19:04:56.581514 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Auth-Token: gAAAAABiq35PnckO-HGwf8Hwj__PpZL_PaDZQrek7hhq3DlpaNeYXhhXK2oBdXFPcw-iYNOW3EbSzzAU011CY_00zFk9KcWRnivqTUh1tGKeoQOEOD15lh4NuH6eGAEF8_gRLAAyQioNPvmVvkInjHcA8S0zJeRo9Qya53p79Vx3821l347rBtc Jun 16 19:04:56.581514 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Domain-Id: None Jun 16 19:04:56.581514 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Domain-Name: None Jun 16 19:04:56.581514 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Identity-Status: Confirmed Jun 16 19:04:56.581514 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Is-Admin-Project: True Jun 16 19:04:56.581514 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Domain-Id: default Jun 16 19:04:56.581514 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Domain-Name: Default Jun 16 19:04:56.581514 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Id: ddb2c879d7f44189ab76e377c33f5e35 Jun 16 19:04:56.581514 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Name: tempest-VolumesSnapshotTestJSON-941902203 Jun 16 19:04:56.581514 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Role: member,reader Jun 16 19:04:56.581514 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Roles: member,reader Jun 16 19:04:56.583973 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ddb2c879d7f44189ab76e377c33f5e35"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_ddb2c879d7f44189ab76e377c33f5e35", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/ddb2c879d7f44189ab76e377c33f5e35"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ddb2c879d7f44189ab76e377c33f5e35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 16 19:04:56.583973 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant: tempest-VolumesSnapshotTestJSON-941902203 Jun 16 19:04:56.583973 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant-Id: ddb2c879d7f44189ab76e377c33f5e35 Jun 16 19:04:56.583973 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-941902203 Jun 16 19:04:56.583973 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User: tempest-VolumesSnapshotTestJSON-941902203-project Jun 16 19:04:56.583973 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Domain-Id: default Jun 16 19:04:56.583973 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Domain-Name: Default Jun 16 19:04:56.583973 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Id: fb08a57a393d4c8591da42cd5e92aca9 Jun 16 19:04:56.583973 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Name: tempest-VolumesSnapshotTestJSON-941902203-project Jun 16 19:04:56.583973 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: method: > Jun 16 19:04:56.583973 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: exception: Instance c771affd-c89b-412f-8ece-422ececa188a could not be found. Jun 16 19:04:56.583973 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: action_args: {'id': 'c771affd-c89b-412f-8ece-422ececa188a'} Jun 16 19:04:56.584901 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:04:56.584901 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:04:56.584901 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:04:56.584901 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:04:56.584901 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:04:56.584901 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:04:56.584901 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:04:56.584901 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:04:56.584901 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:04:56.584901 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:04:56.584901 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c771affd-c89b-412f-8ece-422ececa188a could not be found. Jun 16 19:04:56.584901 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:04:56.584901 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:04:56.584901 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:04:56.584901 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:04:56.584901 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:04:56.584901 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:04:56.584901 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:04:56.584901 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:04:56.584901 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:04:56.586278 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:04:56.586278 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:04:56.586278 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:04:56.586278 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:04:56.586278 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:04:56.586278 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:04:56.586278 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:04:56.586278 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c771affd-c89b-412f-8ece-422ececa188a could not be found. Jun 16 19:04:56.586278 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:04:56.586278 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:04:56.586278 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:04:56.586278 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:04:56.586278 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:04:56.586278 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:04:56.586278 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:04:56.586278 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:04:56.586278 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c771affd-c89b-412f-8ece-422ececa188a could not be found. Jun 16 19:04:56.586278 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:04:56.588304 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-6211e522-1880-4576-9564-f7d3a0bce8cb tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] Returning 404 to user: Instance c771affd-c89b-412f-8ece-422ececa188a could not be found. {{(pid=117850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:04:56.588304 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-6211e522-1880-4576-9564-f7d3a0bce8cb tempest-VolumesSnapshotTestJSON-941902203 tempest-VolumesSnapshotTestJSON-941902203-project] 10.222.0.70 "GET /compute/v2.1/servers/c771affd-c89b-412f-8ece-422ececa188a" status: 404 len: 111 microversion: 2.1 time: 0.030390 Jun 16 19:04:56.588304 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 346/711] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:56 2022] GET /compute/v2.1/servers/c771affd-c89b-412f-8ece-422ececa188a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:04:57.508504 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-0d00ad41-5709-484a-b4d1-52d732f2153a tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:57.509128 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-0d00ad41-5709-484a-b4d1-52d732f2153a tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] [instance: c4277200-c999-4c53-85de-b2a8b120cd6d] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:57.509907 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-11a46e69-58d2-4b08-b171-c1e9da92f996 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:57.510537 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-11a46e69-58d2-4b08-b171-c1e9da92f996 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] [instance: edce90bf-b3d6-49de-a45f-9b65e1759b51] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:57.515851 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-0d00ad41-5709-484a-b4d1-52d732f2153a tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:57.516305 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-0d00ad41-5709-484a-b4d1-52d732f2153a tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:57.517053 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-11a46e69-58d2-4b08-b171-c1e9da92f996 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:57.517172 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-0d00ad41-5709-484a-b4d1-52d732f2153a tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:57.517503 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-11a46e69-58d2-4b08-b171-c1e9da92f996 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:57.517615 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-0d00ad41-5709-484a-b4d1-52d732f2153a tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:57.518261 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-11a46e69-58d2-4b08-b171-c1e9da92f996 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:57.518805 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-11a46e69-58d2-4b08-b171-c1e9da92f996 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:57.533162 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.wsgi [None req-11a46e69-58d2-4b08-b171-c1e9da92f996 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] HTTP exception thrown: Instance edce90bf-b3d6-49de-a45f-9b65e1759b51 could not be found. Jun 16 19:04:57.534750 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-11a46e69-58d2-4b08-b171-c1e9da92f996 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Request method failure captured: Jun 16 19:04:57.534750 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: request: GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51 HTTP/1.1 Jun 16 19:04:57.534750 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Accept: application/json Jun 16 19:04:57.534750 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Accept-Encoding: identity Jun 16 19:04:57.534750 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Connection: close Jun 16 19:04:57.534750 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Content-Length: 0 Jun 16 19:04:57.534750 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Content-Type: application/json Jun 16 19:04:57.534750 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Host: 10.222.0.70 Jun 16 19:04:57.534750 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Openstack-System-Scope: None Jun 16 19:04:57.534750 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: User-Agent: python-urllib3/1.26.9 Jun 16 19:04:57.534750 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Auth-Token: gAAAAABiq33teS2OqFSYP1psKNWWdzfpaJt8TYZPFUEnKK8Y6DM7Q-2AX08ii-pGiMmNNjWJonM33ZcfEzX-84OGvSrAXKgVuNWbwT4OI6L0UT-7MLXXMkmmbADcY_wUw10EK_VcSn2aeqVrjev8yjqJxgHL-uQDtezM01LiXH7PP-f1Ht-WSHo Jun 16 19:04:57.534750 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Domain-Id: None Jun 16 19:04:57.534750 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Domain-Name: None Jun 16 19:04:57.534750 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Identity-Status: Confirmed Jun 16 19:04:57.534750 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Is-Admin-Project: True Jun 16 19:04:57.534750 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Domain-Id: default Jun 16 19:04:57.534750 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Domain-Name: Default Jun 16 19:04:57.534750 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Id: 741ee13164894b49be1a0fc6c1385a8e Jun 16 19:04:57.534750 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Name: tempest-TestMinimumBasicScenario-1766193046 Jun 16 19:04:57.534750 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Role: member,reader Jun 16 19:04:57.534750 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Roles: member,reader Jun 16 19:04:57.536384 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/741ee13164894b49be1a0fc6c1385a8e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_741ee13164894b49be1a0fc6c1385a8e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/741ee13164894b49be1a0fc6c1385a8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/741ee13164894b49be1a0fc6c1385a8e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 16 19:04:57.536384 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant: tempest-TestMinimumBasicScenario-1766193046 Jun 16 19:04:57.536384 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant-Id: 741ee13164894b49be1a0fc6c1385a8e Jun 16 19:04:57.536384 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1766193046 Jun 16 19:04:57.536384 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User: tempest-TestMinimumBasicScenario-1766193046-project Jun 16 19:04:57.536384 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Domain-Id: default Jun 16 19:04:57.536384 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Domain-Name: Default Jun 16 19:04:57.536384 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Id: 047e841cefdd4975947b2c154412953b Jun 16 19:04:57.536384 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Name: tempest-TestMinimumBasicScenario-1766193046-project Jun 16 19:04:57.536384 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: method: > Jun 16 19:04:57.536384 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: exception: Instance edce90bf-b3d6-49de-a45f-9b65e1759b51 could not be found. Jun 16 19:04:57.536384 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: action_args: {'id': 'edce90bf-b3d6-49de-a45f-9b65e1759b51'} Jun 16 19:04:57.540485 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:04:57.540485 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:04:57.540485 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:04:57.540485 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:04:57.540485 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:04:57.540485 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:04:57.540485 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:04:57.540485 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:04:57.540485 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:04:57.540485 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:04:57.540485 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edce90bf-b3d6-49de-a45f-9b65e1759b51 could not be found. Jun 16 19:04:57.540485 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:04:57.540485 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:04:57.540485 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:04:57.540485 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:04:57.540485 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:04:57.540485 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:04:57.540485 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:04:57.540485 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:04:57.540485 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:04:57.541940 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:04:57.541940 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:04:57.541940 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:04:57.541940 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:04:57.541940 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:04:57.541940 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:04:57.541940 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:04:57.541940 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edce90bf-b3d6-49de-a45f-9b65e1759b51 could not be found. Jun 16 19:04:57.541940 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:04:57.541940 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:04:57.541940 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:04:57.541940 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:04:57.541940 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:04:57.541940 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:04:57.541940 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:04:57.541940 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:04:57.541940 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edce90bf-b3d6-49de-a45f-9b65e1759b51 could not be found. Jun 16 19:04:57.541940 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:04:57.543312 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-11a46e69-58d2-4b08-b171-c1e9da92f996 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Returning 404 to user: Instance edce90bf-b3d6-49de-a45f-9b65e1759b51 could not be found. {{(pid=117850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:04:57.543312 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-11a46e69-58d2-4b08-b171-c1e9da92f996 tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] 10.222.0.70 "GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51" status: 404 len: 111 microversion: 2.1 time: 0.030772 Jun 16 19:04:57.543312 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 347/712] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:57 2022] GET /compute/v2.1/servers/edce90bf-b3d6-49de-a45f-9b65e1759b51 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 19:04:57.544840 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-94811c5f-52bf-4f4b-9660-5c99f953af0f tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] Calling method '.version_select at 0x7f12e5c00940>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:57.568173 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-94811c5f-52bf-4f4b-9660-5c99f953af0f tempest-TestMinimumBasicScenario-1766193046 tempest-TestMinimumBasicScenario-1766193046-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2106478105" status: 202 len: 0 microversion: 2.1 time: 0.027003 Jun 16 19:04:57.568754 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 348/713] 10.222.0.70 () {58 vars in 1271 bytes} [Thu Jun 16 19:04:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2106478105 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:04:57.662004 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-0d00ad41-5709-484a-b4d1-52d732f2153a tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27db09b804fa426a83f103cf5dd116a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629634dc3dc54893b68cb9c9dc08505d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:57.669909 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-0d00ad41-5709-484a-b4d1-52d732f2153a tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] 10.222.0.70 "GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d" status: 200 len: 1574 microversion: 2.1 time: 0.166099 Jun 16 19:04:57.670687 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 366/714] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:57 2022] GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d => generated 1574 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:58.688195 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-a842aadc-531e-4ded-884a-e599055aea0e tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:58.688813 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-a842aadc-531e-4ded-884a-e599055aea0e tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] [instance: c4277200-c999-4c53-85de-b2a8b120cd6d] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:58.696633 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-a842aadc-531e-4ded-884a-e599055aea0e tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:58.697091 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-a842aadc-531e-4ded-884a-e599055aea0e tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:58.697919 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-a842aadc-531e-4ded-884a-e599055aea0e tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:58.698362 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-a842aadc-531e-4ded-884a-e599055aea0e tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:58.893529 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-a842aadc-531e-4ded-884a-e599055aea0e tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27db09b804fa426a83f103cf5dd116a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629634dc3dc54893b68cb9c9dc08505d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:04:58.902132 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-a842aadc-531e-4ded-884a-e599055aea0e tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] 10.222.0.70 "GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d" status: 200 len: 1574 microversion: 2.1 time: 0.218580 Jun 16 19:04:58.902772 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 349/715] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:58 2022] GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d => generated 1574 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:04:59.920810 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-ca3bca13-2816-4130-adf8-6416d82b7327 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:04:59.922169 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-ca3bca13-2816-4130-adf8-6416d82b7327 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] [instance: c4277200-c999-4c53-85de-b2a8b120cd6d] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:04:59.929564 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ca3bca13-2816-4130-adf8-6416d82b7327 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:59.930329 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ca3bca13-2816-4130-adf8-6416d82b7327 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:04:59.931157 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ca3bca13-2816-4130-adf8-6416d82b7327 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:04:59.931600 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ca3bca13-2816-4130-adf8-6416d82b7327 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:00.083578 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-ca3bca13-2816-4130-adf8-6416d82b7327 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27db09b804fa426a83f103cf5dd116a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629634dc3dc54893b68cb9c9dc08505d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:00.103090 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-ca3bca13-2816-4130-adf8-6416d82b7327 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] 10.222.0.70 "GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d" status: 200 len: 1574 microversion: 2.1 time: 0.186463 Jun 16 19:05:00.103679 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 367/716] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:04:59 2022] GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d => generated 1574 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:01.121976 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-b3ab169e-03cb-4943-a253-03564b82593d tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:01.122604 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-b3ab169e-03cb-4943-a253-03564b82593d tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] [instance: c4277200-c999-4c53-85de-b2a8b120cd6d] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:01.129732 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b3ab169e-03cb-4943-a253-03564b82593d tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:01.130433 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b3ab169e-03cb-4943-a253-03564b82593d tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:01.131226 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b3ab169e-03cb-4943-a253-03564b82593d tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:01.131659 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b3ab169e-03cb-4943-a253-03564b82593d tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:01.431730 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-b3ab169e-03cb-4943-a253-03564b82593d tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27db09b804fa426a83f103cf5dd116a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629634dc3dc54893b68cb9c9dc08505d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:01.439557 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-b3ab169e-03cb-4943-a253-03564b82593d tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] 10.222.0.70 "GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d" status: 200 len: 1574 microversion: 2.1 time: 0.321961 Jun 16 19:05:01.440121 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 350/717] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:01 2022] GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d => generated 1574 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:01.865309 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-fdd59e10-b6b4-4338-9fd0-abed1e8bcfd0 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:01.865843 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-fdd59e10-b6b4-4338-9fd0-abed1e8bcfd0 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:01.872425 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-fdd59e10-b6b4-4338-9fd0-abed1e8bcfd0 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:01.872872 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-fdd59e10-b6b4-4338-9fd0-abed1e8bcfd0 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:01.873635 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-fdd59e10-b6b4-4338-9fd0-abed1e8bcfd0 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:01.874069 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-fdd59e10-b6b4-4338-9fd0-abed1e8bcfd0 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:01.964089 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.objects.instance [None req-fdd59e10-b6b4-4338-9fd0-abed1e8bcfd0 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lazy-loading 'services' on Instance uuid fdd6d861-ef2f-4b74-ba61-41178438391f {{(pid=117852) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:05:02.038752 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-fdd59e10-b6b4-4338-9fd0-abed1e8bcfd0 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "DELETE /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f/os-volume_attachments/1c861886-2c72-4497-bec7-d33635c67c25" status: 202 len: 0 microversion: 2.1 time: 0.177223 Jun 16 19:05:02.039348 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 368/718] 10.222.0.70 () {58 vars in 1415 bytes} [Thu Jun 16 19:05:01 2022] DELETE /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f/os-volume_attachments/1c861886-2c72-4497-bec7-d33635c67c25 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 19:05:02.047655 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-89ea4fe0-1c00-4a30-9c97-67d5ad41db97 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:02.048583 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-89ea4fe0-1c00-4a30-9c97-67d5ad41db97 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:02.054871 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-89ea4fe0-1c00-4a30-9c97-67d5ad41db97 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:02.055332 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-89ea4fe0-1c00-4a30-9c97-67d5ad41db97 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:02.056140 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-89ea4fe0-1c00-4a30-9c97-67d5ad41db97 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:02.056585 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-89ea4fe0-1c00-4a30-9c97-67d5ad41db97 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:02.089277 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-89ea4fe0-1c00-4a30-9c97-67d5ad41db97 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045388 Jun 16 19:05:02.089848 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 351/719] 10.222.0.70 () {58 vars in 1301 bytes} [Thu Jun 16 19:05:02 2022] GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:05:02.459979 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-c620c785-7be4-4cf9-9918-898c5488bf4d tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:02.461285 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-c620c785-7be4-4cf9-9918-898c5488bf4d tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] [instance: c4277200-c999-4c53-85de-b2a8b120cd6d] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:02.476239 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-c620c785-7be4-4cf9-9918-898c5488bf4d tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:02.477215 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-c620c785-7be4-4cf9-9918-898c5488bf4d tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:02.478732 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-c620c785-7be4-4cf9-9918-898c5488bf4d tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:02.479694 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-c620c785-7be4-4cf9-9918-898c5488bf4d tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:02.772642 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-c620c785-7be4-4cf9-9918-898c5488bf4d tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27db09b804fa426a83f103cf5dd116a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629634dc3dc54893b68cb9c9dc08505d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:02.780437 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-c620c785-7be4-4cf9-9918-898c5488bf4d tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] 10.222.0.70 "GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d" status: 200 len: 1574 microversion: 2.1 time: 0.327044 Jun 16 19:05:02.781201 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 369/720] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:02 2022] GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d => generated 1574 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:03.101383 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-3d9f1741-7c1f-4a91-bf8c-cb66c72a175d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:03.103181 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-3d9f1741-7c1f-4a91-bf8c-cb66c72a175d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:03.110514 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-3d9f1741-7c1f-4a91-bf8c-cb66c72a175d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:03.111292 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-3d9f1741-7c1f-4a91-bf8c-cb66c72a175d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:03.112896 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-3d9f1741-7c1f-4a91-bf8c-cb66c72a175d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:03.114601 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-3d9f1741-7c1f-4a91-bf8c-cb66c72a175d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:03.150105 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-3d9f1741-7c1f-4a91-bf8c-cb66c72a175d tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052779 Jun 16 19:05:03.151100 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 352/721] 10.222.0.70 () {58 vars in 1301 bytes} [Thu Jun 16 19:05:03 2022] GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 19:05:03.252001 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-0c195019-e931-4758-b107-e7cf6092c399 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:03.252675 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-0c195019-e931-4758-b107-e7cf6092c399 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:03.260361 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-0c195019-e931-4758-b107-e7cf6092c399 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:03.260885 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-0c195019-e931-4758-b107-e7cf6092c399 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:03.261827 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-0c195019-e931-4758-b107-e7cf6092c399 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:03.262500 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-0c195019-e931-4758-b107-e7cf6092c399 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:03.291744 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-0c195019-e931-4758-b107-e7cf6092c399 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] Going to try to terminate instance {{(pid=117852) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:05:03.397661 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-0c195019-e931-4758-b107-e7cf6092c399 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "DELETE /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f" status: 204 len: 0 microversion: 2.1 time: 0.150899 Jun 16 19:05:03.401931 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 370/722] 10.222.0.70 () {58 vars in 1238 bytes} [Thu Jun 16 19:05:03 2022] DELETE /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:05:03.407800 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-a2746dad-300a-4ba1-b90c-0b5788e217df tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:03.408589 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-a2746dad-300a-4ba1-b90c-0b5788e217df tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:03.416666 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-a2746dad-300a-4ba1-b90c-0b5788e217df tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:03.417291 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-a2746dad-300a-4ba1-b90c-0b5788e217df tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:03.418334 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-a2746dad-300a-4ba1-b90c-0b5788e217df tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:03.418894 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-a2746dad-300a-4ba1-b90c-0b5788e217df tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:03.626140 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-a2746dad-300a-4ba1-b90c-0b5788e217df tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:03.634121 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-a2746dad-300a-4ba1-b90c-0b5788e217df tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f" status: 200 len: 1691 microversion: 2.1 time: 0.230851 Jun 16 19:05:03.636223 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 353/723] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:03 2022] GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f => generated 1691 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:03.799024 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-18979ddc-3051-4ba1-8ba1-3ebfe9ef5249 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:03.800789 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-18979ddc-3051-4ba1-8ba1-3ebfe9ef5249 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] [instance: c4277200-c999-4c53-85de-b2a8b120cd6d] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:03.822359 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-18979ddc-3051-4ba1-8ba1-3ebfe9ef5249 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:03.822961 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-18979ddc-3051-4ba1-8ba1-3ebfe9ef5249 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:03.823687 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-18979ddc-3051-4ba1-8ba1-3ebfe9ef5249 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:03.824119 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-18979ddc-3051-4ba1-8ba1-3ebfe9ef5249 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:04.004525 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-18979ddc-3051-4ba1-8ba1-3ebfe9ef5249 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27db09b804fa426a83f103cf5dd116a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629634dc3dc54893b68cb9c9dc08505d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:04.025878 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-18979ddc-3051-4ba1-8ba1-3ebfe9ef5249 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] 10.222.0.70 "GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d" status: 200 len: 1574 microversion: 2.1 time: 0.232254 Jun 16 19:05:04.026463 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 371/724] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:03 2022] GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d => generated 1574 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:04.652286 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-ea3c913c-eea0-464d-a802-46a66d383c9a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:04.652907 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-ea3c913c-eea0-464d-a802-46a66d383c9a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:04.660167 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-ea3c913c-eea0-464d-a802-46a66d383c9a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:04.660617 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-ea3c913c-eea0-464d-a802-46a66d383c9a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:04.661389 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-ea3c913c-eea0-464d-a802-46a66d383c9a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:04.661942 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-ea3c913c-eea0-464d-a802-46a66d383c9a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:04.905909 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-ea3c913c-eea0-464d-a802-46a66d383c9a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:04.915314 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-ea3c913c-eea0-464d-a802-46a66d383c9a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f" status: 200 len: 1691 microversion: 2.1 time: 0.266926 Jun 16 19:05:04.915922 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 354/725] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:04 2022] GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f => generated 1691 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:05:05.046469 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-ef7ad5cf-2b31-4d3e-b51a-2f944395ff74 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:05.047422 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-ef7ad5cf-2b31-4d3e-b51a-2f944395ff74 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] [instance: c4277200-c999-4c53-85de-b2a8b120cd6d] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:05.058400 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ef7ad5cf-2b31-4d3e-b51a-2f944395ff74 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:05.059343 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ef7ad5cf-2b31-4d3e-b51a-2f944395ff74 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:05.061141 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ef7ad5cf-2b31-4d3e-b51a-2f944395ff74 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:05.061752 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ef7ad5cf-2b31-4d3e-b51a-2f944395ff74 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:05.230366 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-ef7ad5cf-2b31-4d3e-b51a-2f944395ff74 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27db09b804fa426a83f103cf5dd116a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629634dc3dc54893b68cb9c9dc08505d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:05.245401 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-ef7ad5cf-2b31-4d3e-b51a-2f944395ff74 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] 10.222.0.70 "GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d" status: 200 len: 1574 microversion: 2.1 time: 0.204837 Jun 16 19:05:05.250766 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 372/726] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:05 2022] GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d => generated 1574 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:05.653174 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [req-0620bc59-5e98-4028-8cda-bbdf424726c3 req-ef0b28f3-3ff2-4d3b-a0ba-f5bb9c832723 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4277200-c999-4c53-85de-b2a8b120cd6d", "name": "network-vif-plugged", "status": "completed", "tag": "52aa00b3-538a-446a-8118-2c3fa72e640d"}]} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:05:05.662873 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-0620bc59-5e98-4028-8cda-bbdf424726c3 req-ef0b28f3-3ff2-4d3b-a0ba-f5bb9c832723 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:05.663755 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-0620bc59-5e98-4028-8cda-bbdf424726c3 req-ef0b28f3-3ff2-4d3b-a0ba-f5bb9c832723 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:05.675918 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.compute.server_external_events [req-0620bc59-5e98-4028-8cda-bbdf424726c3 req-ef0b28f3-3ff2-4d3b-a0ba-f5bb9c832723 service nova] Creating event network-vif-plugged:52aa00b3-538a-446a-8118-2c3fa72e640d for instance c4277200-c999-4c53-85de-b2a8b120cd6d on hv-cinder-84617 Jun 16 19:05:05.681036 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [req-0620bc59-5e98-4028-8cda-bbdf424726c3 req-ef0b28f3-3ff2-4d3b-a0ba-f5bb9c832723 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.189919 Jun 16 19:05:05.681653 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 355/727] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:05:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:05:05.934053 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-bd0af042-8ddf-4f81-9027-c6e989b7b8f4 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:05.934999 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-bd0af042-8ddf-4f81-9027-c6e989b7b8f4 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:05.942523 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-bd0af042-8ddf-4f81-9027-c6e989b7b8f4 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:05.943070 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-bd0af042-8ddf-4f81-9027-c6e989b7b8f4 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:05.943792 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-bd0af042-8ddf-4f81-9027-c6e989b7b8f4 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:05.944236 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-bd0af042-8ddf-4f81-9027-c6e989b7b8f4 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:05.949282 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:05:06.102631 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-bd0af042-8ddf-4f81-9027-c6e989b7b8f4 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:06.110180 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-bd0af042-8ddf-4f81-9027-c6e989b7b8f4 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f" status: 200 len: 1691 microversion: 2.1 time: 0.181334 Jun 16 19:05:06.110874 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 373/728] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:05 2022] GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f => generated 1691 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:06.264700 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-30ee93f7-8bd9-403b-94ff-ad33b9eb5806 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:06.265667 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-30ee93f7-8bd9-403b-94ff-ad33b9eb5806 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] [instance: c4277200-c999-4c53-85de-b2a8b120cd6d] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:06.274347 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-30ee93f7-8bd9-403b-94ff-ad33b9eb5806 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:06.275274 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-30ee93f7-8bd9-403b-94ff-ad33b9eb5806 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:06.276267 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-30ee93f7-8bd9-403b-94ff-ad33b9eb5806 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:06.276824 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-30ee93f7-8bd9-403b-94ff-ad33b9eb5806 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:06.297521 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:05:06.446036 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-30ee93f7-8bd9-403b-94ff-ad33b9eb5806 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27db09b804fa426a83f103cf5dd116a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629634dc3dc54893b68cb9c9dc08505d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:06.457078 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-30ee93f7-8bd9-403b-94ff-ad33b9eb5806 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] 10.222.0.70 "GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d" status: 200 len: 1574 microversion: 2.1 time: 0.197067 Jun 16 19:05:06.457861 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 356/729] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:06 2022] GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d => generated 1574 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:07.128141 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-aa6c2aa4-c0a5-4652-88d5-d134aa85daaf tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:07.128760 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-aa6c2aa4-c0a5-4652-88d5-d134aa85daaf tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:07.135305 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-aa6c2aa4-c0a5-4652-88d5-d134aa85daaf tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:07.135763 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-aa6c2aa4-c0a5-4652-88d5-d134aa85daaf tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:07.136526 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-aa6c2aa4-c0a5-4652-88d5-d134aa85daaf tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:07.136967 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-aa6c2aa4-c0a5-4652-88d5-d134aa85daaf tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:07.270297 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-aa6c2aa4-c0a5-4652-88d5-d134aa85daaf tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:07.278282 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-aa6c2aa4-c0a5-4652-88d5-d134aa85daaf tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f" status: 200 len: 1691 microversion: 2.1 time: 0.154039 Jun 16 19:05:07.278889 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 374/730] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:07 2022] GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f => generated 1691 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:07.475659 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-94b83e2b-84ba-4a3f-9228-01083a413a59 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:07.476225 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-94b83e2b-84ba-4a3f-9228-01083a413a59 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] [instance: c4277200-c999-4c53-85de-b2a8b120cd6d] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:07.482924 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-94b83e2b-84ba-4a3f-9228-01083a413a59 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:07.483472 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-94b83e2b-84ba-4a3f-9228-01083a413a59 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:07.484240 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-94b83e2b-84ba-4a3f-9228-01083a413a59 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:07.484699 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-94b83e2b-84ba-4a3f-9228-01083a413a59 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:07.619937 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-94b83e2b-84ba-4a3f-9228-01083a413a59 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27db09b804fa426a83f103cf5dd116a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629634dc3dc54893b68cb9c9dc08505d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:07.627626 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-94b83e2b-84ba-4a3f-9228-01083a413a59 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] 10.222.0.70 "GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d" status: 200 len: 1574 microversion: 2.1 time: 0.156477 Jun 16 19:05:07.628451 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 357/731] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:07 2022] GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:08.296299 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-c99c3a66-5d16-4770-8282-4efa70b76e25 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:08.296860 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-c99c3a66-5d16-4770-8282-4efa70b76e25 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:08.303030 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-c99c3a66-5d16-4770-8282-4efa70b76e25 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:08.303476 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-c99c3a66-5d16-4770-8282-4efa70b76e25 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:08.304220 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-c99c3a66-5d16-4770-8282-4efa70b76e25 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:08.304652 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-c99c3a66-5d16-4770-8282-4efa70b76e25 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:08.433153 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-c99c3a66-5d16-4770-8282-4efa70b76e25 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:08.440743 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-c99c3a66-5d16-4770-8282-4efa70b76e25 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f" status: 200 len: 1691 microversion: 2.1 time: 0.148154 Jun 16 19:05:08.441567 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 375/732] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:08 2022] GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f => generated 1691 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:08.646094 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-03b4cd79-8656-4e9e-8070-9aa6fa60e8e9 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:08.646742 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-03b4cd79-8656-4e9e-8070-9aa6fa60e8e9 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] [instance: c4277200-c999-4c53-85de-b2a8b120cd6d] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:08.653414 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-03b4cd79-8656-4e9e-8070-9aa6fa60e8e9 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:08.653863 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-03b4cd79-8656-4e9e-8070-9aa6fa60e8e9 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:08.654641 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-03b4cd79-8656-4e9e-8070-9aa6fa60e8e9 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:08.655078 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-03b4cd79-8656-4e9e-8070-9aa6fa60e8e9 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:08.786264 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-03b4cd79-8656-4e9e-8070-9aa6fa60e8e9 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27db09b804fa426a83f103cf5dd116a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629634dc3dc54893b68cb9c9dc08505d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:08.794023 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-03b4cd79-8656-4e9e-8070-9aa6fa60e8e9 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] 10.222.0.70 "GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d" status: 200 len: 1574 microversion: 2.1 time: 0.152817 Jun 16 19:05:08.794604 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 358/733] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:08 2022] GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:09.457970 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-f7bc7373-198d-4e65-8f2a-d8f57960cb85 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:09.458828 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-f7bc7373-198d-4e65-8f2a-d8f57960cb85 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:09.465380 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f7bc7373-198d-4e65-8f2a-d8f57960cb85 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:09.465824 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f7bc7373-198d-4e65-8f2a-d8f57960cb85 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:09.466589 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f7bc7373-198d-4e65-8f2a-d8f57960cb85 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:09.467028 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f7bc7373-198d-4e65-8f2a-d8f57960cb85 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:09.600989 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-f7bc7373-198d-4e65-8f2a-d8f57960cb85 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:09.612034 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-f7bc7373-198d-4e65-8f2a-d8f57960cb85 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f" status: 200 len: 1691 microversion: 2.1 time: 0.158074 Jun 16 19:05:09.613251 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 376/734] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:09 2022] GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:09.811601 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-394e0b91-2f27-44ef-a0a3-065c1bf281ce tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:09.812255 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-394e0b91-2f27-44ef-a0a3-065c1bf281ce tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] [instance: c4277200-c999-4c53-85de-b2a8b120cd6d] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:09.820348 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-394e0b91-2f27-44ef-a0a3-065c1bf281ce tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:09.820798 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-394e0b91-2f27-44ef-a0a3-065c1bf281ce tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:09.821601 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-394e0b91-2f27-44ef-a0a3-065c1bf281ce tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:09.822035 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-394e0b91-2f27-44ef-a0a3-065c1bf281ce tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:09.966404 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-394e0b91-2f27-44ef-a0a3-065c1bf281ce tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27db09b804fa426a83f103cf5dd116a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629634dc3dc54893b68cb9c9dc08505d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:09.981692 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-394e0b91-2f27-44ef-a0a3-065c1bf281ce tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] 10.222.0.70 "GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d" status: 200 len: 1574 microversion: 2.1 time: 0.174085 Jun 16 19:05:09.982288 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 359/735] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:09 2022] GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d => generated 1574 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:10.020024 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-1eaf84a5-7ad5-49fa-a3ab-a8f3149314d2 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:10.021051 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-1eaf84a5-7ad5-49fa-a3ab-a8f3149314d2 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:10.027561 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-1eaf84a5-7ad5-49fa-a3ab-a8f3149314d2 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:10.028025 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-1eaf84a5-7ad5-49fa-a3ab-a8f3149314d2 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:10.028828 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-1eaf84a5-7ad5-49fa-a3ab-a8f3149314d2 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:10.029270 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-1eaf84a5-7ad5-49fa-a3ab-a8f3149314d2 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:10.059202 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-1eaf84a5-7ad5-49fa-a3ab-a8f3149314d2 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044670 Jun 16 19:05:10.059765 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 377/736] 10.222.0.70 () {58 vars in 1301 bytes} [Thu Jun 16 19:05:10 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 19:05:10.119114 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-405e39b6-1f8a-40eb-b54d-264147538778 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:10.119607 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-405e39b6-1f8a-40eb-b54d-264147538778 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:10.125466 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-405e39b6-1f8a-40eb-b54d-264147538778 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:10.125911 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-405e39b6-1f8a-40eb-b54d-264147538778 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:10.126687 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-405e39b6-1f8a-40eb-b54d-264147538778 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:10.127119 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-405e39b6-1f8a-40eb-b54d-264147538778 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:10.307651 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-405e39b6-1f8a-40eb-b54d-264147538778 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Going to try to terminate instance {{(pid=117850) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:05:10.382085 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-405e39b6-1f8a-40eb-b54d-264147538778 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "DELETE /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 204 len: 0 microversion: 2.1 time: 0.266388 Jun 16 19:05:10.385997 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 360/737] 10.222.0.70 () {58 vars in 1238 bytes} [Thu Jun 16 19:05:10 2022] DELETE /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:05:10.391568 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-9c18661a-20d4-48ac-a104-d42307c7aeff tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:10.392189 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-9c18661a-20d4-48ac-a104-d42307c7aeff tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:10.400853 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-9c18661a-20d4-48ac-a104-d42307c7aeff tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:10.401358 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-9c18661a-20d4-48ac-a104-d42307c7aeff tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:10.402153 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-9c18661a-20d4-48ac-a104-d42307c7aeff tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:10.402658 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-9c18661a-20d4-48ac-a104-d42307c7aeff tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:10.539828 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-9c18661a-20d4-48ac-a104-d42307c7aeff tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:10.547356 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-9c18661a-20d4-48ac-a104-d42307c7aeff tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1672 microversion: 2.1 time: 0.159885 Jun 16 19:05:10.548341 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 378/738] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:10 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1672 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:05:10.630121 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-87552264-05c7-47f2-a8cc-f146bbe5cbc7 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:10.630965 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-87552264-05c7-47f2-a8cc-f146bbe5cbc7 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:10.637172 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-87552264-05c7-47f2-a8cc-f146bbe5cbc7 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:10.637652 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-87552264-05c7-47f2-a8cc-f146bbe5cbc7 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:10.638422 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-87552264-05c7-47f2-a8cc-f146bbe5cbc7 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:10.638905 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-87552264-05c7-47f2-a8cc-f146bbe5cbc7 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:10.887187 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-87552264-05c7-47f2-a8cc-f146bbe5cbc7 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:10.897826 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-87552264-05c7-47f2-a8cc-f146bbe5cbc7 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f" status: 200 len: 1691 microversion: 2.1 time: 0.272033 Jun 16 19:05:10.908112 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 361/739] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:10 2022] GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f => generated 1691 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:10.999483 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-4ed44508-7734-450c-8d07-708e6e04317f tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:11.000241 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-4ed44508-7734-450c-8d07-708e6e04317f tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] [instance: c4277200-c999-4c53-85de-b2a8b120cd6d] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:11.009518 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-4ed44508-7734-450c-8d07-708e6e04317f tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:11.012401 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-4ed44508-7734-450c-8d07-708e6e04317f tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:11.013415 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-4ed44508-7734-450c-8d07-708e6e04317f tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:11.013907 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-4ed44508-7734-450c-8d07-708e6e04317f tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:11.183107 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-4ed44508-7734-450c-8d07-708e6e04317f tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27db09b804fa426a83f103cf5dd116a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629634dc3dc54893b68cb9c9dc08505d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:11.191769 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-4ed44508-7734-450c-8d07-708e6e04317f tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] 10.222.0.70 "GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d" status: 200 len: 1574 microversion: 2.1 time: 0.196156 Jun 16 19:05:11.192396 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 379/740] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:10 2022] GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d => generated 1574 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:11.361605 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [req-3bbabd8c-ff16-426e-977a-364c305c32d5 req-2974134c-8911-4437-a021-78aca6944326 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdd6d861-ef2f-4b74-ba61-41178438391f", "name": "network-vif-deleted", "tag": "1ac6c4c7-65ae-4602-b8de-8ddcba59c0e5"}]} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:05:11.370673 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-3bbabd8c-ff16-426e-977a-364c305c32d5 req-2974134c-8911-4437-a021-78aca6944326 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:11.371125 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-3bbabd8c-ff16-426e-977a-364c305c32d5 req-2974134c-8911-4437-a021-78aca6944326 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:11.384238 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.compute.server_external_events [req-3bbabd8c-ff16-426e-977a-364c305c32d5 req-2974134c-8911-4437-a021-78aca6944326 service nova] Creating event network-vif-deleted:1ac6c4c7-65ae-4602-b8de-8ddcba59c0e5 for instance fdd6d861-ef2f-4b74-ba61-41178438391f on hv-cinder-84617 Jun 16 19:05:11.389115 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [req-3bbabd8c-ff16-426e-977a-364c305c32d5 req-2974134c-8911-4437-a021-78aca6944326 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031156 Jun 16 19:05:11.389710 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 362/741] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:05:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:05:11.569559 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-8931686f-e9c4-4443-b56c-8e4b8c3da792 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:11.570849 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-8931686f-e9c4-4443-b56c-8e4b8c3da792 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:11.579046 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-8931686f-e9c4-4443-b56c-8e4b8c3da792 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:11.579755 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-8931686f-e9c4-4443-b56c-8e4b8c3da792 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:11.581664 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-8931686f-e9c4-4443-b56c-8e4b8c3da792 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:11.582332 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-8931686f-e9c4-4443-b56c-8e4b8c3da792 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:11.715929 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-8931686f-e9c4-4443-b56c-8e4b8c3da792 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:11.724154 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-8931686f-e9c4-4443-b56c-8e4b8c3da792 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1672 microversion: 2.1 time: 0.161557 Jun 16 19:05:11.724719 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 380/742] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:11 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1672 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:11.916960 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-7dc20601-fded-4720-8270-a850d16a95ce tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:11.917604 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-7dc20601-fded-4720-8270-a850d16a95ce tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:11.924394 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-7dc20601-fded-4720-8270-a850d16a95ce tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:11.925444 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-7dc20601-fded-4720-8270-a850d16a95ce tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:11.926431 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-7dc20601-fded-4720-8270-a850d16a95ce tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:11.926903 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-7dc20601-fded-4720-8270-a850d16a95ce tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:12.209747 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-6d572410-1926-410e-8650-3baae162a8f0 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:12.210388 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-6d572410-1926-410e-8650-3baae162a8f0 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] [instance: c4277200-c999-4c53-85de-b2a8b120cd6d] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:12.218921 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-6d572410-1926-410e-8650-3baae162a8f0 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:12.219617 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-6d572410-1926-410e-8650-3baae162a8f0 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:12.220399 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-6d572410-1926-410e-8650-3baae162a8f0 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:12.220819 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-6d572410-1926-410e-8650-3baae162a8f0 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:12.247729 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-7dc20601-fded-4720-8270-a850d16a95ce tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:12.257135 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-7dc20601-fded-4720-8270-a850d16a95ce tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f" status: 200 len: 1331 microversion: 2.1 time: 0.344200 Jun 16 19:05:12.259351 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 363/743] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:11 2022] GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f => generated 1331 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:12.375541 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-6d572410-1926-410e-8650-3baae162a8f0 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27db09b804fa426a83f103cf5dd116a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629634dc3dc54893b68cb9c9dc08505d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:12.386983 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-6d572410-1926-410e-8650-3baae162a8f0 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] 10.222.0.70 "GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d" status: 200 len: 1574 microversion: 2.1 time: 0.181753 Jun 16 19:05:12.398476 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 381/744] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:12 2022] GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d => generated 1574 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:12.741269 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-97dbe54f-e4c1-4281-9cc1-05d60cfe3e4e tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:12.741797 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-97dbe54f-e4c1-4281-9cc1-05d60cfe3e4e tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:12.748160 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-97dbe54f-e4c1-4281-9cc1-05d60cfe3e4e tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:12.748614 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-97dbe54f-e4c1-4281-9cc1-05d60cfe3e4e tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:12.749413 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-97dbe54f-e4c1-4281-9cc1-05d60cfe3e4e tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:12.749850 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-97dbe54f-e4c1-4281-9cc1-05d60cfe3e4e tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:12.885262 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-97dbe54f-e4c1-4281-9cc1-05d60cfe3e4e tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:12.893041 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-97dbe54f-e4c1-4281-9cc1-05d60cfe3e4e tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1672 microversion: 2.1 time: 0.156240 Jun 16 19:05:12.893601 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 364/745] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:12 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1672 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:13.275003 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-7eb1b71b-2f01-4aff-891b-2713bbe93361 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:13.275753 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-7eb1b71b-2f01-4aff-891b-2713bbe93361 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: fdd6d861-ef2f-4b74-ba61-41178438391f] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:13.282349 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-7eb1b71b-2f01-4aff-891b-2713bbe93361 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:13.282827 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-7eb1b71b-2f01-4aff-891b-2713bbe93361 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:13.283605 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-7eb1b71b-2f01-4aff-891b-2713bbe93361 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:13.284530 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-7eb1b71b-2f01-4aff-891b-2713bbe93361 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:13.304476 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.wsgi [None req-7eb1b71b-2f01-4aff-891b-2713bbe93361 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] HTTP exception thrown: Instance fdd6d861-ef2f-4b74-ba61-41178438391f could not be found. Jun 16 19:05:13.306341 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-7eb1b71b-2f01-4aff-891b-2713bbe93361 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Request method failure captured: Jun 16 19:05:13.306341 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: request: GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f HTTP/1.1 Jun 16 19:05:13.306341 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Accept: application/json Jun 16 19:05:13.306341 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Accept-Encoding: identity Jun 16 19:05:13.306341 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Connection: close Jun 16 19:05:13.306341 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Content-Length: 0 Jun 16 19:05:13.306341 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Content-Type: application/json Jun 16 19:05:13.306341 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Host: 10.222.0.70 Jun 16 19:05:13.306341 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Openstack-System-Scope: None Jun 16 19:05:13.306341 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: User-Agent: python-urllib3/1.26.9 Jun 16 19:05:13.306341 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Auth-Token: gAAAAABiq32MWlG48BHx8XuuslNdJYyJSrfQU2dcwoyRLL7bw-NKnsaA5lLVdqK2IJiUTQDMxha5Lp11Vgbk2btE0OekI4NBXVXjOTkuuqI_1FxxjoULRHMKHfsoz-Idvd1wKyC2h9kbUWif20GzMiR8FTKv464r3WLs3Okv1rHkW7SJoX6YE7s Jun 16 19:05:13.306341 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Domain-Id: None Jun 16 19:05:13.306341 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Domain-Name: None Jun 16 19:05:13.306341 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Identity-Status: Confirmed Jun 16 19:05:13.306341 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Is-Admin-Project: True Jun 16 19:05:13.306341 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Domain-Id: default Jun 16 19:05:13.306341 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Domain-Name: Default Jun 16 19:05:13.306341 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Id: 83b304be7bd84301b898bb50f4ac7ae4 Jun 16 19:05:13.306341 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-548083212 Jun 16 19:05:13.306341 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Role: member,reader Jun 16 19:05:13.306341 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Roles: member,reader Jun 16 19:05:13.308864 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/83b304be7bd84301b898bb50f4ac7ae4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_83b304be7bd84301b898bb50f4ac7ae4", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/83b304be7bd84301b898bb50f4ac7ae4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/83b304be7bd84301b898bb50f4ac7ae4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 16 19:05:13.308864 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant: tempest-ServerRescueNegativeTestJSON-548083212 Jun 16 19:05:13.308864 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant-Id: 83b304be7bd84301b898bb50f4ac7ae4 Jun 16 19:05:13.308864 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-548083212 Jun 16 19:05:13.308864 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User: tempest-ServerRescueNegativeTestJSON-548083212-project Jun 16 19:05:13.308864 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Domain-Id: default Jun 16 19:05:13.308864 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Domain-Name: Default Jun 16 19:05:13.308864 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Id: 7f703f74c7ff43a291f54103e164ccdf Jun 16 19:05:13.308864 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Name: tempest-ServerRescueNegativeTestJSON-548083212-project Jun 16 19:05:13.308864 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: method: > Jun 16 19:05:13.308864 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: exception: Instance fdd6d861-ef2f-4b74-ba61-41178438391f could not be found. Jun 16 19:05:13.308864 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: action_args: {'id': 'fdd6d861-ef2f-4b74-ba61-41178438391f'} Jun 16 19:05:13.310295 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:05:13.310295 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:05:13.310295 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:05:13.310295 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:05:13.310295 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:05:13.310295 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:05:13.310295 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:05:13.310295 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:05:13.310295 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:05:13.310295 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:05:13.310295 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdd6d861-ef2f-4b74-ba61-41178438391f could not be found. Jun 16 19:05:13.310295 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:05:13.310295 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:05:13.310295 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:05:13.310295 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:05:13.310295 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:05:13.310295 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:05:13.310295 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:05:13.310295 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:05:13.310295 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:05:13.318800 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:05:13.318800 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:05:13.318800 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:05:13.318800 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:05:13.318800 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:05:13.318800 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:05:13.318800 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:05:13.318800 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdd6d861-ef2f-4b74-ba61-41178438391f could not be found. Jun 16 19:05:13.318800 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:05:13.318800 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:05:13.318800 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:05:13.318800 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:05:13.318800 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:05:13.318800 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:05:13.318800 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:05:13.318800 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:05:13.318800 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdd6d861-ef2f-4b74-ba61-41178438391f could not be found. Jun 16 19:05:13.318800 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:05:13.324208 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-7eb1b71b-2f01-4aff-891b-2713bbe93361 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Returning 404 to user: Instance fdd6d861-ef2f-4b74-ba61-41178438391f could not be found. {{(pid=117852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:05:13.324208 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-7eb1b71b-2f01-4aff-891b-2713bbe93361 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f" status: 404 len: 111 microversion: 2.1 time: 0.037076 Jun 16 19:05:13.324208 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 382/746] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:13 2022] GET /compute/v2.1/servers/fdd6d861-ef2f-4b74-ba61-41178438391f => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:05:13.327461 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-89256c66-018b-4bdb-8749-ef18a81990c4 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '.version_select at 0x7f12e5d77550>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:13.350559 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-89256c66-018b-4bdb-8749-ef18a81990c4 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1699936319" status: 202 len: 0 microversion: 2.1 time: 0.034952 Jun 16 19:05:13.351472 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 365/747] 10.222.0.70 () {58 vars in 1220 bytes} [Thu Jun 16 19:05:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1699936319 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 19:05:13.407686 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-cf178e81-cef2-413d-8bb8-8379edc433a4 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:13.408300 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-cf178e81-cef2-413d-8bb8-8379edc433a4 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] [instance: c4277200-c999-4c53-85de-b2a8b120cd6d] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:13.429148 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-cf178e81-cef2-413d-8bb8-8379edc433a4 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:13.429591 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-cf178e81-cef2-413d-8bb8-8379edc433a4 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:13.438369 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-cf178e81-cef2-413d-8bb8-8379edc433a4 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:13.439134 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-cf178e81-cef2-413d-8bb8-8379edc433a4 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:13.480596 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [req-3549c041-aaee-4895-aa55-c0b24689839d req-531afb21-ac05-4b98-9a1d-380b5f92ba15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fb4cc0a-23a8-417c-a8a1-35501c2690ee", "name": "network-vif-unplugged", "status": "completed", "tag": "523e7a48-bea7-4e32-9e88-5f62ea569a81"}]} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:05:13.496707 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-3549c041-aaee-4895-aa55-c0b24689839d req-531afb21-ac05-4b98-9a1d-380b5f92ba15 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:13.497141 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-3549c041-aaee-4895-aa55-c0b24689839d req-531afb21-ac05-4b98-9a1d-380b5f92ba15 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:13.514180 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.compute.server_external_events [req-3549c041-aaee-4895-aa55-c0b24689839d req-531afb21-ac05-4b98-9a1d-380b5f92ba15 service nova] Creating event network-vif-unplugged:523e7a48-bea7-4e32-9e88-5f62ea569a81 for instance 2fb4cc0a-23a8-417c-a8a1-35501c2690ee on hv-cinder-84617 Jun 16 19:05:13.521976 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [req-3549c041-aaee-4895-aa55-c0b24689839d req-531afb21-ac05-4b98-9a1d-380b5f92ba15 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045391 Jun 16 19:05:13.525022 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 366/748] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:05:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:05:13.642509 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-cf178e81-cef2-413d-8bb8-8379edc433a4 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27db09b804fa426a83f103cf5dd116a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629634dc3dc54893b68cb9c9dc08505d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:13.652457 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-cf178e81-cef2-413d-8bb8-8379edc433a4 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] 10.222.0.70 "GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d" status: 200 len: 1561 microversion: 2.1 time: 0.248423 Jun 16 19:05:13.653495 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 383/749] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:13 2022] GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d => generated 1561 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:13.915893 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-2c8e9f56-bf19-4532-bfc2-6b9a981a25d6 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:13.917523 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-2c8e9f56-bf19-4532-bfc2-6b9a981a25d6 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:13.925172 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-2c8e9f56-bf19-4532-bfc2-6b9a981a25d6 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:13.925529 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-2c8e9f56-bf19-4532-bfc2-6b9a981a25d6 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:13.926691 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-2c8e9f56-bf19-4532-bfc2-6b9a981a25d6 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:13.927139 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-2c8e9f56-bf19-4532-bfc2-6b9a981a25d6 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:14.265583 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-2c8e9f56-bf19-4532-bfc2-6b9a981a25d6 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:14.273541 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-2c8e9f56-bf19-4532-bfc2-6b9a981a25d6 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1672 microversion: 2.1 time: 0.365965 Jun 16 19:05:14.285537 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 367/750] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:13 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1672 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:14.696771 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [req-f4190ce6-64c0-4286-9f53-97d573482e6d req-581a75a3-4a2c-429b-83fc-8740f33250ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fb4cc0a-23a8-417c-a8a1-35501c2690ee", "name": "network-vif-deleted", "tag": "523e7a48-bea7-4e32-9e88-5f62ea569a81"}]} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:05:14.708107 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-f4190ce6-64c0-4286-9f53-97d573482e6d req-581a75a3-4a2c-429b-83fc-8740f33250ba service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:14.708570 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-f4190ce6-64c0-4286-9f53-97d573482e6d req-581a75a3-4a2c-429b-83fc-8740f33250ba service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:14.734596 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.compute.server_external_events [req-f4190ce6-64c0-4286-9f53-97d573482e6d req-581a75a3-4a2c-429b-83fc-8740f33250ba service nova] Creating event network-vif-deleted:523e7a48-bea7-4e32-9e88-5f62ea569a81 for instance 2fb4cc0a-23a8-417c-a8a1-35501c2690ee on hv-cinder-84617 Jun 16 19:05:14.741386 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [req-f4190ce6-64c0-4286-9f53-97d573482e6d req-581a75a3-4a2c-429b-83fc-8740f33250ba service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049011 Jun 16 19:05:14.742412 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 384/751] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:05:15.291565 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-0058cd58-163f-40f3-8d3f-7c8abc12df3c tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:15.292119 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-0058cd58-163f-40f3-8d3f-7c8abc12df3c tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:15.298648 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0058cd58-163f-40f3-8d3f-7c8abc12df3c tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:15.299106 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0058cd58-163f-40f3-8d3f-7c8abc12df3c tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:15.300477 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0058cd58-163f-40f3-8d3f-7c8abc12df3c tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:15.300919 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0058cd58-163f-40f3-8d3f-7c8abc12df3c tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:15.335247 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0058cd58-163f-40f3-8d3f-7c8abc12df3c tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:15.336231 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0058cd58-163f-40f3-8d3f-7c8abc12df3c tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:15.336692 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.objects.instance [None req-0058cd58-163f-40f3-8d3f-7c8abc12df3c tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lazy-loading 'fault' on Instance uuid 2fb4cc0a-23a8-417c-a8a1-35501c2690ee {{(pid=117850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:05:15.386563 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-0058cd58-163f-40f3-8d3f-7c8abc12df3c tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:15.396989 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-0058cd58-163f-40f3-8d3f-7c8abc12df3c tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 200 len: 1326 microversion: 2.1 time: 0.109409 Jun 16 19:05:15.406924 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 368/752] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:15 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 1326 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:16.415870 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-46d55750-594a-4688-b9d3-0377d7e2ee4c tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:16.416573 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-46d55750-594a-4688-b9d3-0377d7e2ee4c tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:16.422750 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-46d55750-594a-4688-b9d3-0377d7e2ee4c tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:16.423195 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-46d55750-594a-4688-b9d3-0377d7e2ee4c tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:16.423945 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-46d55750-594a-4688-b9d3-0377d7e2ee4c tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:16.424659 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-46d55750-594a-4688-b9d3-0377d7e2ee4c tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:16.437580 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.wsgi [None req-46d55750-594a-4688-b9d3-0377d7e2ee4c tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] HTTP exception thrown: Instance 2fb4cc0a-23a8-417c-a8a1-35501c2690ee could not be found. Jun 16 19:05:16.439187 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-46d55750-594a-4688-b9d3-0377d7e2ee4c tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Request method failure captured: Jun 16 19:05:16.439187 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: request: GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee HTTP/1.1 Jun 16 19:05:16.439187 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Accept: application/json Jun 16 19:05:16.439187 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Accept-Encoding: identity Jun 16 19:05:16.439187 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Connection: close Jun 16 19:05:16.439187 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Content-Length: 0 Jun 16 19:05:16.439187 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Content-Type: application/json Jun 16 19:05:16.439187 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Host: 10.222.0.70 Jun 16 19:05:16.439187 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Openstack-System-Scope: None Jun 16 19:05:16.439187 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: User-Agent: python-urllib3/1.26.9 Jun 16 19:05:16.439187 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Auth-Token: gAAAAABiq32STCJaFXQIp3PzTnZvjl6lE_TcopJhXajXolWMvtX8Nbvxxl2A6BOWdIBYcRqB6SjqOixF3IkG5t1y9pUrVisaB_7h8Kf0i8llu-5_RZzAvGw7ssMl3iqktVqv-nmWcZYep8Ah7GhViBFc9b5VQfaEW_2jV08YDm-3GpmhGdUWTyY Jun 16 19:05:16.439187 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Domain-Id: None Jun 16 19:05:16.439187 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Domain-Name: None Jun 16 19:05:16.439187 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Identity-Status: Confirmed Jun 16 19:05:16.439187 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Is-Admin-Project: True Jun 16 19:05:16.439187 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Domain-Id: default Jun 16 19:05:16.439187 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Domain-Name: Default Jun 16 19:05:16.439187 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Id: d865cf7b3e5c4291a0204f396143083a Jun 16 19:05:16.439187 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Name: tempest-AttachVolumeTestJSON-932291825 Jun 16 19:05:16.439187 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Role: member,reader Jun 16 19:05:16.439187 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Roles: member,reader Jun 16 19:05:16.441521 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d865cf7b3e5c4291a0204f396143083a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d865cf7b3e5c4291a0204f396143083a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d865cf7b3e5c4291a0204f396143083a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d865cf7b3e5c4291a0204f396143083a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 16 19:05:16.441521 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant: tempest-AttachVolumeTestJSON-932291825 Jun 16 19:05:16.441521 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant-Id: d865cf7b3e5c4291a0204f396143083a Jun 16 19:05:16.441521 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant-Name: tempest-AttachVolumeTestJSON-932291825 Jun 16 19:05:16.441521 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User: tempest-AttachVolumeTestJSON-932291825-project Jun 16 19:05:16.441521 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Domain-Id: default Jun 16 19:05:16.441521 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Domain-Name: Default Jun 16 19:05:16.441521 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Id: 8742a73e9b4f46deb0b5c9e1756ffe2e Jun 16 19:05:16.441521 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Name: tempest-AttachVolumeTestJSON-932291825-project Jun 16 19:05:16.441521 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: method: > Jun 16 19:05:16.441521 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: exception: Instance 2fb4cc0a-23a8-417c-a8a1-35501c2690ee could not be found. Jun 16 19:05:16.441521 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: action_args: {'id': '2fb4cc0a-23a8-417c-a8a1-35501c2690ee'} Jun 16 19:05:16.442498 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:05:16.442498 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:05:16.442498 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:05:16.442498 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:05:16.442498 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:05:16.442498 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:05:16.442498 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:05:16.442498 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:05:16.442498 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:05:16.442498 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:05:16.442498 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fb4cc0a-23a8-417c-a8a1-35501c2690ee could not be found. Jun 16 19:05:16.442498 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:05:16.442498 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:05:16.442498 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:05:16.442498 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:05:16.442498 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:05:16.442498 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:05:16.442498 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:05:16.442498 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:05:16.442498 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:05:16.444058 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:05:16.444058 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:05:16.444058 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:05:16.444058 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:05:16.444058 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:05:16.444058 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:05:16.444058 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:05:16.444058 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fb4cc0a-23a8-417c-a8a1-35501c2690ee could not be found. Jun 16 19:05:16.444058 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:05:16.444058 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:05:16.444058 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:05:16.444058 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:05:16.444058 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:05:16.444058 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:05:16.444058 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:05:16.444058 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:05:16.444058 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fb4cc0a-23a8-417c-a8a1-35501c2690ee could not be found. Jun 16 19:05:16.444058 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:05:16.445482 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-46d55750-594a-4688-b9d3-0377d7e2ee4c tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Returning 404 to user: Instance 2fb4cc0a-23a8-417c-a8a1-35501c2690ee could not be found. {{(pid=117852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:05:16.445482 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-46d55750-594a-4688-b9d3-0377d7e2ee4c tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 404 len: 111 microversion: 2.1 time: 0.029881 Jun 16 19:05:16.445482 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 385/753] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:16 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:05:16.450500 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-3eec4044-1f7e-41dd-935c-87f7c652b11c tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '.version_select at 0x7f12e5c47af0>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:16.469338 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-3eec4044-1f7e-41dd-935c-87f7c652b11c tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-644366971" status: 202 len: 0 microversion: 2.1 time: 0.022842 Jun 16 19:05:16.470183 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 369/754] 10.222.0.70 () {58 vars in 1217 bytes} [Thu Jun 16 19:05:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-644366971 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:05:16.522600 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-21b6492d-78c9-4804-9c11-fddb7eba7caa tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:16.523106 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-21b6492d-78c9-4804-9c11-fddb7eba7caa tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1e6f9976-8df1-4719-a873-ab83b056f95e] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:16.529326 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-21b6492d-78c9-4804-9c11-fddb7eba7caa tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:16.529773 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-21b6492d-78c9-4804-9c11-fddb7eba7caa tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:16.530530 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-21b6492d-78c9-4804-9c11-fddb7eba7caa tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:16.530997 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-21b6492d-78c9-4804-9c11-fddb7eba7caa tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:16.560575 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-21b6492d-78c9-4804-9c11-fddb7eba7caa tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1e6f9976-8df1-4719-a873-ab83b056f95e] Going to try to terminate instance {{(pid=117852) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:05:16.646915 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-21b6492d-78c9-4804-9c11-fddb7eba7caa tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "DELETE /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e" status: 204 len: 0 microversion: 2.1 time: 0.128693 Jun 16 19:05:16.650810 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 386/755] 10.222.0.70 () {58 vars in 1238 bytes} [Thu Jun 16 19:05:16 2022] DELETE /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:05:16.656022 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-27a4dfa3-e9e9-4610-a446-46820712f160 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:16.656645 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-27a4dfa3-e9e9-4610-a446-46820712f160 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1e6f9976-8df1-4719-a873-ab83b056f95e] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:16.663387 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-27a4dfa3-e9e9-4610-a446-46820712f160 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:16.663841 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-27a4dfa3-e9e9-4610-a446-46820712f160 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:16.664621 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-27a4dfa3-e9e9-4610-a446-46820712f160 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:16.665057 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-27a4dfa3-e9e9-4610-a446-46820712f160 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:16.803531 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-27a4dfa3-e9e9-4610-a446-46820712f160 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:16.812121 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-27a4dfa3-e9e9-4610-a446-46820712f160 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e" status: 200 len: 1508 microversion: 2.1 time: 0.159975 Jun 16 19:05:16.812707 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 370/756] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:16 2022] GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:17.388728 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-83c1d70e-ffee-40de-a960-336cd36613d5 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Action: 'create', calling method: .version_select at 0x7f12e5cbc8b0>, body: {"keypair": {"name": "tempest-keypair-1754353307", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGR4m/OtYK5a//PuehIlMbkVKv2ZYkL22B2jMdgIC/YA42dCLQ/0UTT5HRbqkAlaFFhJfpp4dlHPnDjpn3LL2Px0i3SQENEx0TAiS8MA7tqrPWnfXVl5ofVbfvfDeYPJ7A=="}} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:05:17.403329 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.quota [None req-83c1d70e-ffee-40de-a960-336cd36613d5 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Getting quotas for project d865cf7b3e5c4291a0204f396143083a. Resources: {'key_pairs'} {{(pid=117852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:05:17.407254 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.quota [None req-83c1d70e-ffee-40de-a960-336cd36613d5 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Getting quotas for user 8742a73e9b4f46deb0b5c9e1756ffe2e and project d865cf7b3e5c4291a0204f396143083a. Resources: {'key_pairs'} {{(pid=117852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:05:17.429979 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-83c1d70e-ffee-40de-a960-336cd36613d5 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045742 Jun 16 19:05:17.430647 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 387/757] 10.222.0.70 () {60 vars in 1158 bytes} [Thu Jun 16 19:05:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:05:17.829428 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-d96fa26a-b1b3-4988-befb-672e37180b03 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:17.830037 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-d96fa26a-b1b3-4988-befb-672e37180b03 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1e6f9976-8df1-4719-a873-ab83b056f95e] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:17.836704 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d96fa26a-b1b3-4988-befb-672e37180b03 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:17.837151 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d96fa26a-b1b3-4988-befb-672e37180b03 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:17.837920 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d96fa26a-b1b3-4988-befb-672e37180b03 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:17.838351 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d96fa26a-b1b3-4988-befb-672e37180b03 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:18.068586 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-d96fa26a-b1b3-4988-befb-672e37180b03 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:18.076426 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-d96fa26a-b1b3-4988-befb-672e37180b03 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e" status: 200 len: 1508 microversion: 2.1 time: 0.250832 Jun 16 19:05:18.076998 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 371/758] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:17 2022] GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e => generated 1508 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:19.096635 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-90d860ff-0c71-448a-9926-fdf832bd1c08 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:19.097583 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-90d860ff-0c71-448a-9926-fdf832bd1c08 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1e6f9976-8df1-4719-a873-ab83b056f95e] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:19.099604 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:05:19.105813 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-90d860ff-0c71-448a-9926-fdf832bd1c08 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:19.106261 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-90d860ff-0c71-448a-9926-fdf832bd1c08 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:19.107055 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-90d860ff-0c71-448a-9926-fdf832bd1c08 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:19.107486 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-90d860ff-0c71-448a-9926-fdf832bd1c08 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:19.187561 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-90d860ff-0c71-448a-9926-fdf832bd1c08 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:19.192379 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [req-b06c7ea5-9a0f-4fa6-9404-bbd111f1722f req-21a761fd-1031-4169-b907-53c94ca68e96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e6f9976-8df1-4719-a873-ab83b056f95e", "name": "network-vif-deleted", "tag": "00684661-7e70-4475-bd72-3ea8303e4612"}]} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:05:19.200482 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-90d860ff-0c71-448a-9926-fdf832bd1c08 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e" status: 200 len: 1466 microversion: 2.1 time: 0.108407 Jun 16 19:05:19.207054 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 388/759] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:19 2022] GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e => generated 1466 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:19.212114 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-b06c7ea5-9a0f-4fa6-9404-bbd111f1722f req-21a761fd-1031-4169-b907-53c94ca68e96 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:19.214772 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-b06c7ea5-9a0f-4fa6-9404-bbd111f1722f req-21a761fd-1031-4169-b907-53c94ca68e96 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:19.228536 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.compute.server_external_events [req-b06c7ea5-9a0f-4fa6-9404-bbd111f1722f req-21a761fd-1031-4169-b907-53c94ca68e96 service nova] Creating event network-vif-deleted:00684661-7e70-4475-bd72-3ea8303e4612 for instance 1e6f9976-8df1-4719-a873-ab83b056f95e on hv-cinder-84617 Jun 16 19:05:19.235354 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [req-b06c7ea5-9a0f-4fa6-9404-bbd111f1722f req-21a761fd-1031-4169-b907-53c94ca68e96 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046461 Jun 16 19:05:19.236816 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 372/760] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:05:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:05:19.432607 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-9ede01f5-9b99-4374-902d-d53a0b870edf tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1685947952", "imageRef": "1d993e69-7f01-4fe0-ba52-0eae2fa43ddf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9c908ec1-4026-4e51-a872-55ce45d602ca"}], "security_groups": [{"name": "tempest-securitygroup--419809733"}], "key_name": "tempest-keypair-1754353307", "user_data": "}} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:05:19.539481 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.network.neutron [None req-9ede01f5-9b99-4374-902d-d53a0b870edf tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] validate_networks() for [('9c908ec1-4026-4e51-a872-55ce45d602ca', None, None, None, None, None)] {{(pid=117852) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:05:19.951988 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.virt.hardware [None req-9ede01f5-9b99-4374-902d-d53a0b870edf tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Flavor limits 0:0:0 {{(pid=117852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:05:19.952412 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.virt.hardware [None req-9ede01f5-9b99-4374-902d-d53a0b870edf tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Image limits 0:0:0 {{(pid=117852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:05:19.952904 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.virt.hardware [None req-9ede01f5-9b99-4374-902d-d53a0b870edf tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Flavor pref 0:0:0 {{(pid=117852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:05:19.953311 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.virt.hardware [None req-9ede01f5-9b99-4374-902d-d53a0b870edf tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Image pref 0:0:0 {{(pid=117852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:05:19.953706 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.virt.hardware [None req-9ede01f5-9b99-4374-902d-d53a0b870edf tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:05:19.962788 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-9ede01f5-9b99-4374-902d-d53a0b870edf tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:19.963237 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-9ede01f5-9b99-4374-902d-d53a0b870edf tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:19.964030 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-9ede01f5-9b99-4374-902d-d53a0b870edf tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:19.964466 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-9ede01f5-9b99-4374-902d-d53a0b870edf tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:19.981877 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.quota [None req-9ede01f5-9b99-4374-902d-d53a0b870edf tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Getting quotas for project d865cf7b3e5c4291a0204f396143083a. Resources: {'cores', 'ram', 'instances'} {{(pid=117852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:05:19.985815 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.quota [None req-9ede01f5-9b99-4374-902d-d53a0b870edf tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Getting quotas for user 8742a73e9b4f46deb0b5c9e1756ffe2e and project d865cf7b3e5c4291a0204f396143083a. Resources: {'cores', 'ram', 'instances'} {{(pid=117852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:05:19.997609 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-9ede01f5-9b99-4374-902d-d53a0b870edf tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Going to run 1 instances... {{(pid=117852) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:05:19.999890 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-9ede01f5-9b99-4374-902d-d53a0b870edf tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 6c2833a5-6276-4288-8c3e-1e82a8a2cca5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1d993e69-7f01-4fe0-ba52-0eae2fa43ddf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117852) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:05:20.044360 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-9ede01f5-9b99-4374-902d-d53a0b870edf tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.616380 Jun 16 19:05:20.045079 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 389/761] 10.222.0.70 () {60 vars in 1146 bytes} [Thu Jun 16 19:05:19 2022] POST /compute/v2.1/servers => generated 401 bytes in 618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:05:20.056440 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-3447cd96-0c3e-4df4-8210-211280cef2e8 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:20.057260 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-3447cd96-0c3e-4df4-8210-211280cef2e8 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 6c2833a5-6276-4288-8c3e-1e82a8a2cca5] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:20.059501 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:05:20.119549 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-3447cd96-0c3e-4df4-8210-211280cef2e8 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:20.126379 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-3447cd96-0c3e-4df4-8210-211280cef2e8 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/6c2833a5-6276-4288-8c3e-1e82a8a2cca5" status: 200 len: 1238 microversion: 2.1 time: 0.074176 Jun 16 19:05:20.127380 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 373/762] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:20 2022] GET /compute/v2.1/servers/6c2833a5-6276-4288-8c3e-1e82a8a2cca5 => generated 1238 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:20.220573 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-69eaa002-d549-4845-86b4-324a1a4754af tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:20.222403 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-69eaa002-d549-4845-86b4-324a1a4754af tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1e6f9976-8df1-4719-a873-ab83b056f95e] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:20.228471 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-69eaa002-d549-4845-86b4-324a1a4754af tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:20.228919 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-69eaa002-d549-4845-86b4-324a1a4754af tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:20.229680 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-69eaa002-d549-4845-86b4-324a1a4754af tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:20.230167 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-69eaa002-d549-4845-86b4-324a1a4754af tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:20.244033 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.wsgi [None req-69eaa002-d549-4845-86b4-324a1a4754af tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] HTTP exception thrown: Instance 1e6f9976-8df1-4719-a873-ab83b056f95e could not be found. Jun 16 19:05:20.245871 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-69eaa002-d549-4845-86b4-324a1a4754af tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Request method failure captured: Jun 16 19:05:20.245871 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: request: GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e HTTP/1.1 Jun 16 19:05:20.245871 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Accept: application/json Jun 16 19:05:20.245871 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Accept-Encoding: identity Jun 16 19:05:20.245871 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Connection: close Jun 16 19:05:20.245871 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Content-Length: 0 Jun 16 19:05:20.245871 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Content-Type: application/json Jun 16 19:05:20.245871 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Host: 10.222.0.70 Jun 16 19:05:20.245871 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Openstack-System-Scope: None Jun 16 19:05:20.245871 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: User-Agent: python-urllib3/1.26.9 Jun 16 19:05:20.245871 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Auth-Token: gAAAAABiq32MWlG48BHx8XuuslNdJYyJSrfQU2dcwoyRLL7bw-NKnsaA5lLVdqK2IJiUTQDMxha5Lp11Vgbk2btE0OekI4NBXVXjOTkuuqI_1FxxjoULRHMKHfsoz-Idvd1wKyC2h9kbUWif20GzMiR8FTKv464r3WLs3Okv1rHkW7SJoX6YE7s Jun 16 19:05:20.245871 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Domain-Id: None Jun 16 19:05:20.245871 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Domain-Name: None Jun 16 19:05:20.245871 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Identity-Status: Confirmed Jun 16 19:05:20.245871 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Is-Admin-Project: True Jun 16 19:05:20.245871 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Domain-Id: default Jun 16 19:05:20.245871 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Domain-Name: Default Jun 16 19:05:20.245871 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Id: 83b304be7bd84301b898bb50f4ac7ae4 Jun 16 19:05:20.245871 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-548083212 Jun 16 19:05:20.245871 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Role: member,reader Jun 16 19:05:20.245871 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Roles: member,reader Jun 16 19:05:20.247634 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/83b304be7bd84301b898bb50f4ac7ae4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_83b304be7bd84301b898bb50f4ac7ae4", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/83b304be7bd84301b898bb50f4ac7ae4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/83b304be7bd84301b898bb50f4ac7ae4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 16 19:05:20.247634 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant: tempest-ServerRescueNegativeTestJSON-548083212 Jun 16 19:05:20.247634 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant-Id: 83b304be7bd84301b898bb50f4ac7ae4 Jun 16 19:05:20.247634 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-548083212 Jun 16 19:05:20.247634 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User: tempest-ServerRescueNegativeTestJSON-548083212-project Jun 16 19:05:20.247634 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Domain-Id: default Jun 16 19:05:20.247634 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Domain-Name: Default Jun 16 19:05:20.247634 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Id: 7f703f74c7ff43a291f54103e164ccdf Jun 16 19:05:20.247634 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Name: tempest-ServerRescueNegativeTestJSON-548083212-project Jun 16 19:05:20.247634 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: method: > Jun 16 19:05:20.247634 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: exception: Instance 1e6f9976-8df1-4719-a873-ab83b056f95e could not be found. Jun 16 19:05:20.247634 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: action_args: {'id': '1e6f9976-8df1-4719-a873-ab83b056f95e'} Jun 16 19:05:20.248822 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:05:20.248822 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:05:20.248822 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:05:20.248822 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:05:20.248822 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:05:20.248822 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:05:20.248822 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:05:20.248822 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:05:20.248822 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:05:20.248822 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:05:20.248822 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e6f9976-8df1-4719-a873-ab83b056f95e could not be found. Jun 16 19:05:20.248822 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:05:20.248822 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:05:20.248822 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:05:20.248822 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:05:20.248822 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:05:20.248822 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:05:20.248822 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:05:20.248822 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:05:20.248822 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:05:20.250597 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:05:20.250597 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:05:20.250597 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:05:20.250597 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:05:20.250597 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:05:20.250597 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:05:20.250597 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:05:20.250597 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e6f9976-8df1-4719-a873-ab83b056f95e could not be found. Jun 16 19:05:20.250597 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:05:20.250597 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:05:20.250597 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:05:20.250597 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:05:20.250597 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:05:20.250597 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:05:20.250597 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:05:20.250597 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:05:20.250597 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e6f9976-8df1-4719-a873-ab83b056f95e could not be found. Jun 16 19:05:20.250597 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:05:20.252327 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-69eaa002-d549-4845-86b4-324a1a4754af tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Returning 404 to user: Instance 1e6f9976-8df1-4719-a873-ab83b056f95e could not be found. {{(pid=117852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:05:20.252327 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-69eaa002-d549-4845-86b4-324a1a4754af tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e" status: 404 len: 111 microversion: 2.1 time: 0.031636 Jun 16 19:05:20.252327 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 390/763] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:20 2022] GET /compute/v2.1/servers/1e6f9976-8df1-4719-a873-ab83b056f95e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:05:20.257265 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-4d482bbf-ce30-4daa-8f21-33c4c2ba98d6 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:20.257783 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-4d482bbf-ce30-4daa-8f21-33c4c2ba98d6 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1407f346-2c64-41d0-b983-268e60273230] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:20.264909 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-4d482bbf-ce30-4daa-8f21-33c4c2ba98d6 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:20.265361 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-4d482bbf-ce30-4daa-8f21-33c4c2ba98d6 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:20.266140 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-4d482bbf-ce30-4daa-8f21-33c4c2ba98d6 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:20.266615 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-4d482bbf-ce30-4daa-8f21-33c4c2ba98d6 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:20.294321 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-4d482bbf-ce30-4daa-8f21-33c4c2ba98d6 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1407f346-2c64-41d0-b983-268e60273230] Going to try to terminate instance {{(pid=117850) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:05:20.344642 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:05:20.380241 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-4d482bbf-ce30-4daa-8f21-33c4c2ba98d6 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "DELETE /compute/v2.1/servers/1407f346-2c64-41d0-b983-268e60273230" status: 204 len: 0 microversion: 2.1 time: 0.126997 Jun 16 19:05:20.381402 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 374/764] 10.222.0.70 () {58 vars in 1238 bytes} [Thu Jun 16 19:05:20 2022] DELETE /compute/v2.1/servers/1407f346-2c64-41d0-b983-268e60273230 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:05:20.389685 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-1364998f-7c95-41e5-9832-160b5a59453f tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:20.390845 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-1364998f-7c95-41e5-9832-160b5a59453f tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1407f346-2c64-41d0-b983-268e60273230] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:20.398274 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-1364998f-7c95-41e5-9832-160b5a59453f tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:20.398805 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-1364998f-7c95-41e5-9832-160b5a59453f tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:20.399933 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-1364998f-7c95-41e5-9832-160b5a59453f tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:20.400582 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-1364998f-7c95-41e5-9832-160b5a59453f tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:20.538250 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-1364998f-7c95-41e5-9832-160b5a59453f tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:20.545719 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-1364998f-7c95-41e5-9832-160b5a59453f tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1407f346-2c64-41d0-b983-268e60273230" status: 200 len: 1520 microversion: 2.1 time: 0.160233 Jun 16 19:05:20.546276 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 391/765] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:20 2022] GET /compute/v2.1/servers/1407f346-2c64-41d0-b983-268e60273230 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:05:21.146245 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-51d3ab35-695a-4508-aba0-fbacc325ae3f tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:21.147215 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-51d3ab35-695a-4508-aba0-fbacc325ae3f tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 6c2833a5-6276-4288-8c3e-1e82a8a2cca5] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:21.155586 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-51d3ab35-695a-4508-aba0-fbacc325ae3f tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:21.156042 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-51d3ab35-695a-4508-aba0-fbacc325ae3f tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:21.156815 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-51d3ab35-695a-4508-aba0-fbacc325ae3f tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:21.157352 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-51d3ab35-695a-4508-aba0-fbacc325ae3f tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:21.224757 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-51d3ab35-695a-4508-aba0-fbacc325ae3f tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:21.232746 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-51d3ab35-695a-4508-aba0-fbacc325ae3f tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/6c2833a5-6276-4288-8c3e-1e82a8a2cca5" status: 200 len: 1242 microversion: 2.1 time: 0.092322 Jun 16 19:05:21.233600 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 375/766] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:21 2022] GET /compute/v2.1/servers/6c2833a5-6276-4288-8c3e-1e82a8a2cca5 => generated 1242 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:21.564013 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-057afb9a-1ebd-482d-9103-07faa3fcc074 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:21.565230 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-057afb9a-1ebd-482d-9103-07faa3fcc074 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1407f346-2c64-41d0-b983-268e60273230] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:21.572609 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-057afb9a-1ebd-482d-9103-07faa3fcc074 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:21.573052 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-057afb9a-1ebd-482d-9103-07faa3fcc074 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:21.573836 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-057afb9a-1ebd-482d-9103-07faa3fcc074 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:21.574266 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-057afb9a-1ebd-482d-9103-07faa3fcc074 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:21.595092 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:05:21.720097 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-057afb9a-1ebd-482d-9103-07faa3fcc074 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:21.728362 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-057afb9a-1ebd-482d-9103-07faa3fcc074 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1407f346-2c64-41d0-b983-268e60273230" status: 200 len: 1520 microversion: 2.1 time: 0.168349 Jun 16 19:05:21.728916 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 392/767] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:21 2022] GET /compute/v2.1/servers/1407f346-2c64-41d0-b983-268e60273230 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:22.249686 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-950dd160-6b87-49b4-bc35-9d59ed553532 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:22.250324 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-950dd160-6b87-49b4-bc35-9d59ed553532 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 6c2833a5-6276-4288-8c3e-1e82a8a2cca5] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:22.257456 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-950dd160-6b87-49b4-bc35-9d59ed553532 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:22.257898 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-950dd160-6b87-49b4-bc35-9d59ed553532 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:22.258699 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-950dd160-6b87-49b4-bc35-9d59ed553532 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:22.259138 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-950dd160-6b87-49b4-bc35-9d59ed553532 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:22.321884 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-950dd160-6b87-49b4-bc35-9d59ed553532 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:22.329317 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-950dd160-6b87-49b4-bc35-9d59ed553532 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/6c2833a5-6276-4288-8c3e-1e82a8a2cca5" status: 200 len: 1242 microversion: 2.1 time: 0.083524 Jun 16 19:05:22.329868 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 376/768] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:22 2022] GET /compute/v2.1/servers/6c2833a5-6276-4288-8c3e-1e82a8a2cca5 => generated 1242 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:22.745187 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-877ea1f3-4eba-4faf-9012-435fd0290c76 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:22.745915 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-877ea1f3-4eba-4faf-9012-435fd0290c76 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1407f346-2c64-41d0-b983-268e60273230] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:22.752647 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-877ea1f3-4eba-4faf-9012-435fd0290c76 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:22.753125 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-877ea1f3-4eba-4faf-9012-435fd0290c76 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:22.753893 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-877ea1f3-4eba-4faf-9012-435fd0290c76 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:22.754334 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-877ea1f3-4eba-4faf-9012-435fd0290c76 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:22.900389 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-877ea1f3-4eba-4faf-9012-435fd0290c76 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:22.908591 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-877ea1f3-4eba-4faf-9012-435fd0290c76 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1407f346-2c64-41d0-b983-268e60273230" status: 200 len: 1520 microversion: 2.1 time: 0.167280 Jun 16 19:05:22.909336 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 393/769] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:22 2022] GET /compute/v2.1/servers/1407f346-2c64-41d0-b983-268e60273230 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:23.345479 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-4b4af5ea-b0e6-48e9-991e-742410f8a6b2 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:23.346296 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-4b4af5ea-b0e6-48e9-991e-742410f8a6b2 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 6c2833a5-6276-4288-8c3e-1e82a8a2cca5] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:23.353407 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-4b4af5ea-b0e6-48e9-991e-742410f8a6b2 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:23.353952 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-4b4af5ea-b0e6-48e9-991e-742410f8a6b2 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:23.354952 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-4b4af5ea-b0e6-48e9-991e-742410f8a6b2 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:23.355651 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-4b4af5ea-b0e6-48e9-991e-742410f8a6b2 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:23.508858 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-4b4af5ea-b0e6-48e9-991e-742410f8a6b2 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:23.517290 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-4b4af5ea-b0e6-48e9-991e-742410f8a6b2 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/6c2833a5-6276-4288-8c3e-1e82a8a2cca5" status: 200 len: 1298 microversion: 2.1 time: 0.175858 Jun 16 19:05:23.518067 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 377/770] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:23 2022] GET /compute/v2.1/servers/6c2833a5-6276-4288-8c3e-1e82a8a2cca5 => generated 1298 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:23.926564 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-46a46903-807d-45d1-adc7-69849f4bd88a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:23.927971 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-46a46903-807d-45d1-adc7-69849f4bd88a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1407f346-2c64-41d0-b983-268e60273230] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:23.935512 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-46a46903-807d-45d1-adc7-69849f4bd88a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:23.936111 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-46a46903-807d-45d1-adc7-69849f4bd88a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:23.937423 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-46a46903-807d-45d1-adc7-69849f4bd88a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:23.937863 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-46a46903-807d-45d1-adc7-69849f4bd88a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:24.011747 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [req-83b2cbf4-14e1-421a-8d7e-4f8a7e49c64d req-71c1a7f8-0d20-47b7-99f7-047be75c6f41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1407f346-2c64-41d0-b983-268e60273230", "name": "network-vif-deleted", "tag": "52a8ab2b-91b4-4c2c-b7aa-df9981b16adf"}]} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:05:24.013743 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-46a46903-807d-45d1-adc7-69849f4bd88a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f703f74c7ff43a291f54103e164ccdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b304be7bd84301b898bb50f4ac7ae4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:24.022862 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-46a46903-807d-45d1-adc7-69849f4bd88a tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1407f346-2c64-41d0-b983-268e60273230" status: 200 len: 1478 microversion: 2.1 time: 0.101375 Jun 16 19:05:24.023615 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 394/771] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:23 2022] GET /compute/v2.1/servers/1407f346-2c64-41d0-b983-268e60273230 => generated 1478 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:24.027075 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-83b2cbf4-14e1-421a-8d7e-4f8a7e49c64d req-71c1a7f8-0d20-47b7-99f7-047be75c6f41 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:24.028131 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-83b2cbf4-14e1-421a-8d7e-4f8a7e49c64d req-71c1a7f8-0d20-47b7-99f7-047be75c6f41 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:24.043141 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.compute.server_external_events [req-83b2cbf4-14e1-421a-8d7e-4f8a7e49c64d req-71c1a7f8-0d20-47b7-99f7-047be75c6f41 service nova] Creating event network-vif-deleted:52a8ab2b-91b4-4c2c-b7aa-df9981b16adf for instance 1407f346-2c64-41d0-b983-268e60273230 on hv-cinder-84617 Jun 16 19:05:24.049323 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [req-83b2cbf4-14e1-421a-8d7e-4f8a7e49c64d req-71c1a7f8-0d20-47b7-99f7-047be75c6f41 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045598 Jun 16 19:05:24.050073 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 378/772] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:05:24.536181 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-26919253-3322-447b-b61d-9c10a5723e11 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:24.537116 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-26919253-3322-447b-b61d-9c10a5723e11 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 6c2833a5-6276-4288-8c3e-1e82a8a2cca5] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:24.543922 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-26919253-3322-447b-b61d-9c10a5723e11 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:24.545069 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-26919253-3322-447b-b61d-9c10a5723e11 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:24.546035 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-26919253-3322-447b-b61d-9c10a5723e11 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:24.546479 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-26919253-3322-447b-b61d-9c10a5723e11 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:24.702495 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-26919253-3322-447b-b61d-9c10a5723e11 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:24.711555 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-26919253-3322-447b-b61d-9c10a5723e11 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/6c2833a5-6276-4288-8c3e-1e82a8a2cca5" status: 200 len: 1363 microversion: 2.1 time: 0.179993 Jun 16 19:05:24.712223 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 395/773] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:24 2022] GET /compute/v2.1/servers/6c2833a5-6276-4288-8c3e-1e82a8a2cca5 => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:25.041599 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-e64d0f43-7046-42ca-acd5-7740a07e8a33 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:25.042455 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-e64d0f43-7046-42ca-acd5-7740a07e8a33 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] [instance: 1407f346-2c64-41d0-b983-268e60273230] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:25.051208 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-e64d0f43-7046-42ca-acd5-7740a07e8a33 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:25.052032 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-e64d0f43-7046-42ca-acd5-7740a07e8a33 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:25.052913 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-e64d0f43-7046-42ca-acd5-7740a07e8a33 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:25.053580 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-e64d0f43-7046-42ca-acd5-7740a07e8a33 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:25.069612 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.wsgi [None req-e64d0f43-7046-42ca-acd5-7740a07e8a33 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] HTTP exception thrown: Instance 1407f346-2c64-41d0-b983-268e60273230 could not be found. Jun 16 19:05:25.071350 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-e64d0f43-7046-42ca-acd5-7740a07e8a33 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Request method failure captured: Jun 16 19:05:25.071350 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: request: GET /compute/v2.1/servers/1407f346-2c64-41d0-b983-268e60273230 HTTP/1.1 Jun 16 19:05:25.071350 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Accept: application/json Jun 16 19:05:25.071350 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Accept-Encoding: identity Jun 16 19:05:25.071350 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Connection: close Jun 16 19:05:25.071350 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Content-Length: 0 Jun 16 19:05:25.071350 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Content-Type: application/json Jun 16 19:05:25.071350 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Host: 10.222.0.70 Jun 16 19:05:25.071350 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Openstack-System-Scope: None Jun 16 19:05:25.071350 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: User-Agent: python-urllib3/1.26.9 Jun 16 19:05:25.071350 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Auth-Token: gAAAAABiq32MWlG48BHx8XuuslNdJYyJSrfQU2dcwoyRLL7bw-NKnsaA5lLVdqK2IJiUTQDMxha5Lp11Vgbk2btE0OekI4NBXVXjOTkuuqI_1FxxjoULRHMKHfsoz-Idvd1wKyC2h9kbUWif20GzMiR8FTKv464r3WLs3Okv1rHkW7SJoX6YE7s Jun 16 19:05:25.071350 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Domain-Id: None Jun 16 19:05:25.071350 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Domain-Name: None Jun 16 19:05:25.071350 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Identity-Status: Confirmed Jun 16 19:05:25.071350 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Is-Admin-Project: True Jun 16 19:05:25.071350 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Domain-Id: default Jun 16 19:05:25.071350 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Domain-Name: Default Jun 16 19:05:25.071350 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Id: 83b304be7bd84301b898bb50f4ac7ae4 Jun 16 19:05:25.071350 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-548083212 Jun 16 19:05:25.071350 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Role: member,reader Jun 16 19:05:25.071350 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Roles: member,reader Jun 16 19:05:25.072791 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/83b304be7bd84301b898bb50f4ac7ae4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_83b304be7bd84301b898bb50f4ac7ae4", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/83b304be7bd84301b898bb50f4ac7ae4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/83b304be7bd84301b898bb50f4ac7ae4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 16 19:05:25.072791 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant: tempest-ServerRescueNegativeTestJSON-548083212 Jun 16 19:05:25.072791 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant-Id: 83b304be7bd84301b898bb50f4ac7ae4 Jun 16 19:05:25.072791 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-548083212 Jun 16 19:05:25.072791 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User: tempest-ServerRescueNegativeTestJSON-548083212-project Jun 16 19:05:25.072791 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Domain-Id: default Jun 16 19:05:25.072791 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Domain-Name: Default Jun 16 19:05:25.072791 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Id: 7f703f74c7ff43a291f54103e164ccdf Jun 16 19:05:25.072791 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Name: tempest-ServerRescueNegativeTestJSON-548083212-project Jun 16 19:05:25.072791 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: method: > Jun 16 19:05:25.072791 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: exception: Instance 1407f346-2c64-41d0-b983-268e60273230 could not be found. Jun 16 19:05:25.072791 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: action_args: {'id': '1407f346-2c64-41d0-b983-268e60273230'} Jun 16 19:05:25.073673 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:05:25.073673 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:05:25.073673 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:05:25.073673 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:05:25.073673 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:05:25.073673 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:05:25.073673 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:05:25.073673 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:05:25.073673 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:05:25.073673 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:05:25.073673 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1407f346-2c64-41d0-b983-268e60273230 could not be found. Jun 16 19:05:25.073673 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:05:25.073673 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:05:25.073673 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:05:25.073673 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:05:25.073673 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:05:25.073673 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:05:25.073673 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:05:25.073673 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:05:25.073673 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:05:25.075244 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:05:25.075244 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:05:25.075244 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:05:25.075244 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:05:25.075244 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:05:25.075244 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:05:25.075244 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:05:25.075244 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1407f346-2c64-41d0-b983-268e60273230 could not be found. Jun 16 19:05:25.075244 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:05:25.075244 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:05:25.075244 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:05:25.075244 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:05:25.075244 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:05:25.075244 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:05:25.075244 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:05:25.075244 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:05:25.075244 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1407f346-2c64-41d0-b983-268e60273230 could not be found. Jun 16 19:05:25.075244 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:05:25.077415 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-e64d0f43-7046-42ca-acd5-7740a07e8a33 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] Returning 404 to user: Instance 1407f346-2c64-41d0-b983-268e60273230 could not be found. {{(pid=117850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:05:25.078448 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-e64d0f43-7046-42ca-acd5-7740a07e8a33 tempest-ServerRescueNegativeTestJSON-548083212 tempest-ServerRescueNegativeTestJSON-548083212-project] 10.222.0.70 "GET /compute/v2.1/servers/1407f346-2c64-41d0-b983-268e60273230" status: 404 len: 111 microversion: 2.1 time: 0.041389 Jun 16 19:05:25.079055 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 379/774] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:25 2022] GET /compute/v2.1/servers/1407f346-2c64-41d0-b983-268e60273230 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:05:25.729415 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-8bad727d-2ba3-4151-96ca-fe6515d9a4b9 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:25.730034 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-8bad727d-2ba3-4151-96ca-fe6515d9a4b9 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 6c2833a5-6276-4288-8c3e-1e82a8a2cca5] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:25.736851 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-8bad727d-2ba3-4151-96ca-fe6515d9a4b9 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:25.737735 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-8bad727d-2ba3-4151-96ca-fe6515d9a4b9 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:25.738510 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-8bad727d-2ba3-4151-96ca-fe6515d9a4b9 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:25.738981 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-8bad727d-2ba3-4151-96ca-fe6515d9a4b9 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:25.939013 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-8bad727d-2ba3-4151-96ca-fe6515d9a4b9 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:25.947657 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-8bad727d-2ba3-4151-96ca-fe6515d9a4b9 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/6c2833a5-6276-4288-8c3e-1e82a8a2cca5" status: 200 len: 1363 microversion: 2.1 time: 0.222307 Jun 16 19:05:25.948230 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 396/775] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:25 2022] GET /compute/v2.1/servers/6c2833a5-6276-4288-8c3e-1e82a8a2cca5 => generated 1363 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:26.075442 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [req-a3d37b40-3212-4b73-a712-a5fefe190170 req-bfe4f4c3-8d5b-4541-95e8-f87b6a9230ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c2833a5-6276-4288-8c3e-1e82a8a2cca5", "tag": "ff5aa27e-cd5d-417e-9860-45906e62e4f9"}]} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:05:26.085718 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-a3d37b40-3212-4b73-a712-a5fefe190170 req-bfe4f4c3-8d5b-4541-95e8-f87b6a9230ed service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:26.086230 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-a3d37b40-3212-4b73-a712-a5fefe190170 req-bfe4f4c3-8d5b-4541-95e8-f87b6a9230ed service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:26.099209 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.compute.server_external_events [req-a3d37b40-3212-4b73-a712-a5fefe190170 req-bfe4f4c3-8d5b-4541-95e8-f87b6a9230ed service nova] Creating event network-changed:ff5aa27e-cd5d-417e-9860-45906e62e4f9 for instance 6c2833a5-6276-4288-8c3e-1e82a8a2cca5 on hv-cinder-84617 Jun 16 19:05:26.105007 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [req-a3d37b40-3212-4b73-a712-a5fefe190170 req-bfe4f4c3-8d5b-4541-95e8-f87b6a9230ed service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033205 Jun 16 19:05:26.105633 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 380/776] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:05:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:05:26.967934 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-7d708379-280b-4ad3-abdf-4b0313381661 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:26.969408 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-7d708379-280b-4ad3-abdf-4b0313381661 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 6c2833a5-6276-4288-8c3e-1e82a8a2cca5] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:26.984433 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-7d708379-280b-4ad3-abdf-4b0313381661 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:26.985820 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-7d708379-280b-4ad3-abdf-4b0313381661 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:26.986803 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-7d708379-280b-4ad3-abdf-4b0313381661 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:26.987401 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-7d708379-280b-4ad3-abdf-4b0313381661 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:27.213425 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-7d708379-280b-4ad3-abdf-4b0313381661 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:27.222107 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-7d708379-280b-4ad3-abdf-4b0313381661 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/6c2833a5-6276-4288-8c3e-1e82a8a2cca5" status: 200 len: 1363 microversion: 2.1 time: 0.258460 Jun 16 19:05:27.224787 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 397/777] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:26 2022] GET /compute/v2.1/servers/6c2833a5-6276-4288-8c3e-1e82a8a2cca5 => generated 1363 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:28.241662 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-b3783a4a-349b-42e0-821b-2a9280102ca7 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:28.242510 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-b3783a4a-349b-42e0-821b-2a9280102ca7 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 6c2833a5-6276-4288-8c3e-1e82a8a2cca5] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:28.249604 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b3783a4a-349b-42e0-821b-2a9280102ca7 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:28.250075 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b3783a4a-349b-42e0-821b-2a9280102ca7 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:28.250880 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b3783a4a-349b-42e0-821b-2a9280102ca7 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:28.251342 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b3783a4a-349b-42e0-821b-2a9280102ca7 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:28.397490 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-b3783a4a-349b-42e0-821b-2a9280102ca7 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:28.405602 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-b3783a4a-349b-42e0-821b-2a9280102ca7 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/6c2833a5-6276-4288-8c3e-1e82a8a2cca5" status: 200 len: 1363 microversion: 2.1 time: 0.168169 Jun 16 19:05:28.407501 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 381/778] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:28 2022] GET /compute/v2.1/servers/6c2833a5-6276-4288-8c3e-1e82a8a2cca5 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:29.424367 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-b4935a6c-e944-496d-a7d5-bd5393393c67 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:29.425144 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-b4935a6c-e944-496d-a7d5-bd5393393c67 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 6c2833a5-6276-4288-8c3e-1e82a8a2cca5] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:29.432565 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-b4935a6c-e944-496d-a7d5-bd5393393c67 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:29.433017 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-b4935a6c-e944-496d-a7d5-bd5393393c67 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:29.433784 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-b4935a6c-e944-496d-a7d5-bd5393393c67 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:29.434242 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-b4935a6c-e944-496d-a7d5-bd5393393c67 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:29.528082 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [req-b6aabfad-1928-4a6b-8399-b4efa9b22f0f req-5eed0175-d98e-4ceb-a034-ce1fbe408542 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c2833a5-6276-4288-8c3e-1e82a8a2cca5", "name": "network-vif-plugged", "status": "completed", "tag": "ff5aa27e-cd5d-417e-9860-45906e62e4f9"}]} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:05:29.540380 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-b6aabfad-1928-4a6b-8399-b4efa9b22f0f req-5eed0175-d98e-4ceb-a034-ce1fbe408542 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:29.540839 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-b6aabfad-1928-4a6b-8399-b4efa9b22f0f req-5eed0175-d98e-4ceb-a034-ce1fbe408542 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:29.555835 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.compute.server_external_events [req-b6aabfad-1928-4a6b-8399-b4efa9b22f0f req-5eed0175-d98e-4ceb-a034-ce1fbe408542 service nova] Creating event network-vif-plugged:ff5aa27e-cd5d-417e-9860-45906e62e4f9 for instance 6c2833a5-6276-4288-8c3e-1e82a8a2cca5 on hv-cinder-84617 Jun 16 19:05:29.562008 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [req-b6aabfad-1928-4a6b-8399-b4efa9b22f0f req-5eed0175-d98e-4ceb-a034-ce1fbe408542 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037822 Jun 16 19:05:29.562625 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 382/779] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:05:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:05:29.625555 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-b4935a6c-e944-496d-a7d5-bd5393393c67 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:29.635176 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-b4935a6c-e944-496d-a7d5-bd5393393c67 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/6c2833a5-6276-4288-8c3e-1e82a8a2cca5" status: 200 len: 1363 microversion: 2.1 time: 0.214885 Jun 16 19:05:29.639997 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 398/780] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:29 2022] GET /compute/v2.1/servers/6c2833a5-6276-4288-8c3e-1e82a8a2cca5 => generated 1363 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:30.652618 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_cell0:SELECT=2 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:05:30.657842 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-981e12c0-3d96-4bdf-90b5-ae377dce9b62 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:30.659858 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-981e12c0-3d96-4bdf-90b5-ae377dce9b62 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 6c2833a5-6276-4288-8c3e-1e82a8a2cca5] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:30.667374 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-981e12c0-3d96-4bdf-90b5-ae377dce9b62 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:30.667841 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-981e12c0-3d96-4bdf-90b5-ae377dce9b62 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:30.668641 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-981e12c0-3d96-4bdf-90b5-ae377dce9b62 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:30.669081 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-981e12c0-3d96-4bdf-90b5-ae377dce9b62 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:30.806178 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-981e12c0-3d96-4bdf-90b5-ae377dce9b62 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:30.814935 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-981e12c0-3d96-4bdf-90b5-ae377dce9b62 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/6c2833a5-6276-4288-8c3e-1e82a8a2cca5" status: 200 len: 1363 microversion: 2.1 time: 0.163063 Jun 16 19:05:30.815513 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 383/781] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:30 2022] GET /compute/v2.1/servers/6c2833a5-6276-4288-8c3e-1e82a8a2cca5 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:31.834805 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-33fc614c-d249-403b-aa18-2b6d1244ec6e tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:31.835940 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-33fc614c-d249-403b-aa18-2b6d1244ec6e tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 6c2833a5-6276-4288-8c3e-1e82a8a2cca5] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:31.839129 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_cell0:SELECT=2 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:05:31.840190 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_cell0:SELECT=10 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:05:31.850736 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-33fc614c-d249-403b-aa18-2b6d1244ec6e tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:31.851227 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-33fc614c-d249-403b-aa18-2b6d1244ec6e tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:31.852485 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-33fc614c-d249-403b-aa18-2b6d1244ec6e tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:31.853339 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-33fc614c-d249-403b-aa18-2b6d1244ec6e tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:31.993186 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-33fc614c-d249-403b-aa18-2b6d1244ec6e tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:32.000841 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-33fc614c-d249-403b-aa18-2b6d1244ec6e tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/6c2833a5-6276-4288-8c3e-1e82a8a2cca5" status: 200 len: 1549 microversion: 2.1 time: 0.172590 Jun 16 19:05:32.001400 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 399/782] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:31 2022] GET /compute/v2.1/servers/6c2833a5-6276-4288-8c3e-1e82a8a2cca5 => generated 1549 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:32.018894 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-9573463f-01a3-4884-af10-7ced0dac932e tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:32.019462 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-9573463f-01a3-4884-af10-7ced0dac932e tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 6c2833a5-6276-4288-8c3e-1e82a8a2cca5] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:32.026475 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-9573463f-01a3-4884-af10-7ced0dac932e tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:32.027036 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-9573463f-01a3-4884-af10-7ced0dac932e tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:32.027865 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-9573463f-01a3-4884-af10-7ced0dac932e tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:32.028369 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-9573463f-01a3-4884-af10-7ced0dac932e tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:32.107967 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-9573463f-01a3-4884-af10-7ced0dac932e tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/6c2833a5-6276-4288-8c3e-1e82a8a2cca5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093752 Jun 16 19:05:32.108557 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 384/783] 10.222.0.70 () {58 vars in 1274 bytes} [Thu Jun 16 19:05:32 2022] GET /compute/v2.1/servers/6c2833a5-6276-4288-8c3e-1e82a8a2cca5/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:05:33.325101 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [req-fb92255b-0b0a-4891-81bf-75359df793e3 req-1d176203-b03b-4034-b2e2-805116bc0ff9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c2833a5-6276-4288-8c3e-1e82a8a2cca5", "tag": "ff5aa27e-cd5d-417e-9860-45906e62e4f9"}]} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:05:33.335333 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-fb92255b-0b0a-4891-81bf-75359df793e3 req-1d176203-b03b-4034-b2e2-805116bc0ff9 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:33.335790 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-fb92255b-0b0a-4891-81bf-75359df793e3 req-1d176203-b03b-4034-b2e2-805116bc0ff9 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:33.347475 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.compute.server_external_events [req-fb92255b-0b0a-4891-81bf-75359df793e3 req-1d176203-b03b-4034-b2e2-805116bc0ff9 service nova] Creating event network-changed:ff5aa27e-cd5d-417e-9860-45906e62e4f9 for instance 6c2833a5-6276-4288-8c3e-1e82a8a2cca5 on hv-cinder-84617 Jun 16 19:05:33.352775 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [req-fb92255b-0b0a-4891-81bf-75359df793e3 req-1d176203-b03b-4034-b2e2-805116bc0ff9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031362 Jun 16 19:05:33.353580 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 400/784] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:05:34.799593 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-623ddd3a-ee97-46ca-8c92-5528406b1054 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:34.800131 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-623ddd3a-ee97-46ca-8c92-5528406b1054 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:34.806486 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-623ddd3a-ee97-46ca-8c92-5528406b1054 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:34.807019 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-623ddd3a-ee97-46ca-8c92-5528406b1054 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:34.807823 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-623ddd3a-ee97-46ca-8c92-5528406b1054 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:34.808297 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-623ddd3a-ee97-46ca-8c92-5528406b1054 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:34.835845 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-623ddd3a-ee97-46ca-8c92-5528406b1054 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6/ips" status: 200 len: 152 microversion: 2.20 time: 0.041257 Jun 16 19:05:34.836428 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 385/785] 10.222.0.70 () {60 vars in 1288 bytes} [Thu Jun 16 19:05:34 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6/ips => generated 152 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 19:05:35.274302 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-1bf28121-6847-4815-8834-ea1c5129184f tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:35.275235 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-1bf28121-6847-4815-8834-ea1c5129184f tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: b99da3e1-cab4-41a0-a1e4-6a29efeb77f2] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:35.281933 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-1bf28121-6847-4815-8834-ea1c5129184f tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:35.282387 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-1bf28121-6847-4815-8834-ea1c5129184f tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:35.283811 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-1bf28121-6847-4815-8834-ea1c5129184f tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:35.284252 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-1bf28121-6847-4815-8834-ea1c5129184f tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:35.308731 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-1bf28121-6847-4815-8834-ea1c5129184f tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: b99da3e1-cab4-41a0-a1e4-6a29efeb77f2] Going to try to terminate instance {{(pid=117852) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:05:35.383326 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-1bf28121-6847-4815-8834-ea1c5129184f tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "DELETE /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2" status: 204 len: 0 microversion: 2.1 time: 0.113044 Jun 16 19:05:35.383951 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 401/786] 10.222.0.70 () {58 vars in 1238 bytes} [Thu Jun 16 19:05:35 2022] DELETE /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:05:35.392776 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-2fd8919f-8169-4e2a-8ca5-7f1ccd53f6c7 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:35.393932 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-2fd8919f-8169-4e2a-8ca5-7f1ccd53f6c7 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: b99da3e1-cab4-41a0-a1e4-6a29efeb77f2] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:35.401522 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-2fd8919f-8169-4e2a-8ca5-7f1ccd53f6c7 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:35.401975 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-2fd8919f-8169-4e2a-8ca5-7f1ccd53f6c7 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:35.402790 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-2fd8919f-8169-4e2a-8ca5-7f1ccd53f6c7 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:35.403229 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-2fd8919f-8169-4e2a-8ca5-7f1ccd53f6c7 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:35.544703 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-2fd8919f-8169-4e2a-8ca5-7f1ccd53f6c7 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:35.552163 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-2fd8919f-8169-4e2a-8ca5-7f1ccd53f6c7 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2" status: 200 len: 1579 microversion: 2.1 time: 0.164007 Jun 16 19:05:35.552710 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 386/787] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:35 2022] GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2 => generated 1579 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:36.570713 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-75b9fc21-2d80-4118-a5aa-335eae09527f tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:36.571372 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-75b9fc21-2d80-4118-a5aa-335eae09527f tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: b99da3e1-cab4-41a0-a1e4-6a29efeb77f2] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:36.577807 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-75b9fc21-2d80-4118-a5aa-335eae09527f tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:36.578260 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-75b9fc21-2d80-4118-a5aa-335eae09527f tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:36.579064 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-75b9fc21-2d80-4118-a5aa-335eae09527f tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:36.579632 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-75b9fc21-2d80-4118-a5aa-335eae09527f tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:36.715182 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-75b9fc21-2d80-4118-a5aa-335eae09527f tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:36.723549 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-75b9fc21-2d80-4118-a5aa-335eae09527f tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2" status: 200 len: 1579 microversion: 2.1 time: 0.157204 Jun 16 19:05:36.724112 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 402/788] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:36 2022] GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2 => generated 1579 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:37.741189 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-d2acfd5b-891d-4204-ab34-91ac07b80e9e tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:37.741804 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-d2acfd5b-891d-4204-ab34-91ac07b80e9e tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: b99da3e1-cab4-41a0-a1e4-6a29efeb77f2] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:37.748300 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d2acfd5b-891d-4204-ab34-91ac07b80e9e tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:37.748750 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d2acfd5b-891d-4204-ab34-91ac07b80e9e tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:37.749513 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d2acfd5b-891d-4204-ab34-91ac07b80e9e tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:37.749949 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d2acfd5b-891d-4204-ab34-91ac07b80e9e tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:37.889051 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-d2acfd5b-891d-4204-ab34-91ac07b80e9e tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:37.897727 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-d2acfd5b-891d-4204-ab34-91ac07b80e9e tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2" status: 200 len: 1579 microversion: 2.1 time: 0.160533 Jun 16 19:05:37.898387 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 387/789] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:37 2022] GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2 => generated 1579 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:38.172056 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-66953347-da2c-43c2-8f18-b8cb6ba230eb tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:05:38.172687 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-66953347-da2c-43c2-8f18-b8cb6ba230eb tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:38.179365 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-66953347-da2c-43c2-8f18-b8cb6ba230eb tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:38.179886 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-66953347-da2c-43c2-8f18-b8cb6ba230eb tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:38.180739 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-66953347-da2c-43c2-8f18-b8cb6ba230eb tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:38.181239 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-66953347-da2c-43c2-8f18-b8cb6ba230eb tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:38.205903 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.objects.instance [None req-66953347-da2c-43c2-8f18-b8cb6ba230eb tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lazy-loading 'flavor' on Instance uuid ac8de877-3a07-4017-99fb-45b37ef123b6 {{(pid=117852) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:05:38.485610 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-66953347-da2c-43c2-8f18-b8cb6ba230eb tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "POST /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6/action" status: 202 len: 0 microversion: 2.20 time: 0.317372 Jun 16 19:05:38.487773 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 403/790] 10.222.0.70 () {62 vars in 1318 bytes} [Thu Jun 16 19:05:38 2022] POST /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6/action => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:05:38.495787 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-f9ddcbed-ff47-480b-994f-9658ff090ba5 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:38.496448 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-f9ddcbed-ff47-480b-994f-9658ff090ba5 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:38.504390 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-f9ddcbed-ff47-480b-994f-9658ff090ba5 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:38.504929 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-f9ddcbed-ff47-480b-994f-9658ff090ba5 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:38.506196 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-f9ddcbed-ff47-480b-994f-9658ff090ba5 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:38.506738 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-f9ddcbed-ff47-480b-994f-9658ff090ba5 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:38.645307 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-f9ddcbed-ff47-480b-994f-9658ff090ba5 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:38.653519 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-f9ddcbed-ff47-480b-994f-9658ff090ba5 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:38.655073 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-f9ddcbed-ff47-480b-994f-9658ff090ba5 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:38.656229 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-f9ddcbed-ff47-480b-994f-9658ff090ba5 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 200 len: 1725 microversion: 2.20 time: 0.164357 Jun 16 19:05:38.656780 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 388/791] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:05:38 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:05:38.916015 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-ca7bd62f-d5ad-4dbb-9d8a-60de48efaf11 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:38.916788 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-ca7bd62f-d5ad-4dbb-9d8a-60de48efaf11 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: b99da3e1-cab4-41a0-a1e4-6a29efeb77f2] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:38.923088 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ca7bd62f-d5ad-4dbb-9d8a-60de48efaf11 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:38.924106 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ca7bd62f-d5ad-4dbb-9d8a-60de48efaf11 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:38.924886 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ca7bd62f-d5ad-4dbb-9d8a-60de48efaf11 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:38.925298 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ca7bd62f-d5ad-4dbb-9d8a-60de48efaf11 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:39.060604 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-ca7bd62f-d5ad-4dbb-9d8a-60de48efaf11 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:39.068539 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-ca7bd62f-d5ad-4dbb-9d8a-60de48efaf11 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2" status: 200 len: 1579 microversion: 2.1 time: 0.156792 Jun 16 19:05:39.069099 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 404/792] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:38 2022] GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2 => generated 1579 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:39.676987 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-ff10910c-65bd-4212-a497-a1c287c17a99 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:39.677624 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-ff10910c-65bd-4212-a497-a1c287c17a99 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:39.684502 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-ff10910c-65bd-4212-a497-a1c287c17a99 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:39.685123 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-ff10910c-65bd-4212-a497-a1c287c17a99 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:39.686250 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-ff10910c-65bd-4212-a497-a1c287c17a99 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:39.686885 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-ff10910c-65bd-4212-a497-a1c287c17a99 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:39.789086 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [req-002308fe-8e56-45f1-9c0c-c243f13ed47f req-c0b75347-68b6-4a49-b1ba-44c50b0ee888 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b99da3e1-cab4-41a0-a1e4-6a29efeb77f2", "name": "network-vif-deleted", "tag": "3e69a90c-a36f-422b-a615-de50c8751ec1"}]} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:05:39.805227 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-002308fe-8e56-45f1-9c0c-c243f13ed47f req-c0b75347-68b6-4a49-b1ba-44c50b0ee888 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:39.805704 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-002308fe-8e56-45f1-9c0c-c243f13ed47f req-c0b75347-68b6-4a49-b1ba-44c50b0ee888 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:39.819735 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.compute.server_external_events [req-002308fe-8e56-45f1-9c0c-c243f13ed47f req-c0b75347-68b6-4a49-b1ba-44c50b0ee888 service nova] Creating event network-vif-deleted:3e69a90c-a36f-422b-a615-de50c8751ec1 for instance b99da3e1-cab4-41a0-a1e4-6a29efeb77f2 on hv-cinder-84617 Jun 16 19:05:39.829980 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [req-002308fe-8e56-45f1-9c0c-c243f13ed47f req-c0b75347-68b6-4a49-b1ba-44c50b0ee888 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046186 Jun 16 19:05:39.833748 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 405/793] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:05:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:05:39.907933 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-ff10910c-65bd-4212-a497-a1c287c17a99 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:39.918870 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-ff10910c-65bd-4212-a497-a1c287c17a99 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:39.920936 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-ff10910c-65bd-4212-a497-a1c287c17a99 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:39.922755 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-ff10910c-65bd-4212-a497-a1c287c17a99 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 200 len: 1725 microversion: 2.20 time: 0.251054 Jun 16 19:05:39.925817 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 389/794] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:05:39 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 1725 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:05:40.087139 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-3e407e63-2924-453f-8593-4c718370c0d8 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:40.087827 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-3e407e63-2924-453f-8593-4c718370c0d8 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: b99da3e1-cab4-41a0-a1e4-6a29efeb77f2] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:40.094085 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-3e407e63-2924-453f-8593-4c718370c0d8 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:40.094798 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-3e407e63-2924-453f-8593-4c718370c0d8 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:40.096374 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-3e407e63-2924-453f-8593-4c718370c0d8 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:40.096965 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-3e407e63-2924-453f-8593-4c718370c0d8 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:40.164426 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-3e407e63-2924-453f-8593-4c718370c0d8 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:40.168326 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:05:40.175648 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-3e407e63-2924-453f-8593-4c718370c0d8 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2" status: 200 len: 1225 microversion: 2.1 time: 0.092610 Jun 16 19:05:40.186638 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 406/795] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:40 2022] GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2 => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:40.943627 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-cb542348-2627-4cf2-b55b-c7c20ae3a3b5 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:40.944892 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-cb542348-2627-4cf2-b55b-c7c20ae3a3b5 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:40.951958 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-cb542348-2627-4cf2-b55b-c7c20ae3a3b5 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:40.952604 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-cb542348-2627-4cf2-b55b-c7c20ae3a3b5 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:40.957076 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-cb542348-2627-4cf2-b55b-c7c20ae3a3b5 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:40.957076 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-cb542348-2627-4cf2-b55b-c7c20ae3a3b5 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:41.099461 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-cb542348-2627-4cf2-b55b-c7c20ae3a3b5 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:41.107654 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-cb542348-2627-4cf2-b55b-c7c20ae3a3b5 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:41.109173 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-cb542348-2627-4cf2-b55b-c7c20ae3a3b5 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:41.110355 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-cb542348-2627-4cf2-b55b-c7c20ae3a3b5 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 200 len: 1725 microversion: 2.20 time: 0.171743 Jun 16 19:05:41.111016 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 390/796] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:05:40 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:05:41.194637 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-6c0956a4-f115-46a5-b09c-d3ba0c2afd67 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:41.195387 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-6c0956a4-f115-46a5-b09c-d3ba0c2afd67 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: b99da3e1-cab4-41a0-a1e4-6a29efeb77f2] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:41.203424 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-6c0956a4-f115-46a5-b09c-d3ba0c2afd67 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:41.203958 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-6c0956a4-f115-46a5-b09c-d3ba0c2afd67 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:41.205596 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-6c0956a4-f115-46a5-b09c-d3ba0c2afd67 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:41.206131 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-6c0956a4-f115-46a5-b09c-d3ba0c2afd67 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:41.220833 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.wsgi [None req-6c0956a4-f115-46a5-b09c-d3ba0c2afd67 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] HTTP exception thrown: Instance b99da3e1-cab4-41a0-a1e4-6a29efeb77f2 could not be found. Jun 16 19:05:41.223237 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-6c0956a4-f115-46a5-b09c-d3ba0c2afd67 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Request method failure captured: Jun 16 19:05:41.223237 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: request: GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2 HTTP/1.1 Jun 16 19:05:41.223237 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Accept: application/json Jun 16 19:05:41.223237 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Accept-Encoding: identity Jun 16 19:05:41.223237 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Connection: close Jun 16 19:05:41.223237 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Content-Length: 0 Jun 16 19:05:41.223237 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Content-Type: application/json Jun 16 19:05:41.223237 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Host: 10.222.0.70 Jun 16 19:05:41.223237 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Openstack-System-Scope: None Jun 16 19:05:41.223237 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: User-Agent: python-urllib3/1.26.9 Jun 16 19:05:41.223237 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Auth-Token: gAAAAABiq34F0WyM-_m2GEpkRZwRHfO_AB5SyRKIXbNNWHY2sls-HrF1ksg_iyTwvnWda4lapZqvkXEw9BGAuK62Bq3Ctr5CYGeAEeCIv7lesaNZGekTBTExdJGHeCjMt9EKJOTndixhoLPqoEBLbAQr4Tttu7d3G1qANcrdeLc5Vq94gfak7Xw Jun 16 19:05:41.223237 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Domain-Id: None Jun 16 19:05:41.223237 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Domain-Name: None Jun 16 19:05:41.223237 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Identity-Status: Confirmed Jun 16 19:05:41.223237 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Is-Admin-Project: True Jun 16 19:05:41.223237 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Domain-Id: default Jun 16 19:05:41.223237 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Domain-Name: Default Jun 16 19:05:41.223237 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Id: 0e52189be8d24c9894ef05cc7acf367c Jun 16 19:05:41.223237 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Name: tempest-TestVolumeBootPattern-1500718300 Jun 16 19:05:41.223237 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Role: member,reader Jun 16 19:05:41.223237 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Roles: member,reader Jun 16 19:05:41.225898 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0e52189be8d24c9894ef05cc7acf367c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0e52189be8d24c9894ef05cc7acf367c", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0e52189be8d24c9894ef05cc7acf367c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0e52189be8d24c9894ef05cc7acf367c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 16 19:05:41.225898 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant: tempest-TestVolumeBootPattern-1500718300 Jun 16 19:05:41.225898 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant-Id: 0e52189be8d24c9894ef05cc7acf367c Jun 16 19:05:41.225898 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant-Name: tempest-TestVolumeBootPattern-1500718300 Jun 16 19:05:41.225898 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User: tempest-TestVolumeBootPattern-1500718300-project Jun 16 19:05:41.225898 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Domain-Id: default Jun 16 19:05:41.225898 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Domain-Name: Default Jun 16 19:05:41.225898 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Id: 922a970a740444a2959c6aa1d0921ee7 Jun 16 19:05:41.225898 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Name: tempest-TestVolumeBootPattern-1500718300-project Jun 16 19:05:41.225898 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: method: > Jun 16 19:05:41.225898 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: exception: Instance b99da3e1-cab4-41a0-a1e4-6a29efeb77f2 could not be found. Jun 16 19:05:41.225898 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: action_args: {'id': 'b99da3e1-cab4-41a0-a1e4-6a29efeb77f2'} Jun 16 19:05:41.227750 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:05:41.227750 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:05:41.227750 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:05:41.227750 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:05:41.227750 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:05:41.227750 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:05:41.227750 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:05:41.227750 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:05:41.227750 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:05:41.227750 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:05:41.227750 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b99da3e1-cab4-41a0-a1e4-6a29efeb77f2 could not be found. Jun 16 19:05:41.227750 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:05:41.227750 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:05:41.227750 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:05:41.227750 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:05:41.227750 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:05:41.227750 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:05:41.227750 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:05:41.227750 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:05:41.227750 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:05:41.230405 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:05:41.230405 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:05:41.230405 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:05:41.230405 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:05:41.230405 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:05:41.230405 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:05:41.230405 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:05:41.230405 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b99da3e1-cab4-41a0-a1e4-6a29efeb77f2 could not be found. Jun 16 19:05:41.230405 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:05:41.230405 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:05:41.230405 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:05:41.230405 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:05:41.230405 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:05:41.230405 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:05:41.230405 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:05:41.230405 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:05:41.230405 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b99da3e1-cab4-41a0-a1e4-6a29efeb77f2 could not be found. Jun 16 19:05:41.230405 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:05:41.232905 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-6c0956a4-f115-46a5-b09c-d3ba0c2afd67 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Returning 404 to user: Instance b99da3e1-cab4-41a0-a1e4-6a29efeb77f2 could not be found. {{(pid=117852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:05:41.232905 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-6c0956a4-f115-46a5-b09c-d3ba0c2afd67 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2" status: 404 len: 111 microversion: 2.1 time: 0.034450 Jun 16 19:05:41.232905 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 407/797] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:41 2022] GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:05:41.340918 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-a095934b-fdf7-4db3-babd-1b4ebddf483e tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-91374394", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-550046181", "security_groups": [{"name": "tempest-secgroup-smoke-1355388580"}], "block_device_mapping_v2": [{"uuid": "387f10a2-dc85-4824-b031-a1aa7eefadaf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "11bba4c6-eed3-44ef-bcb5-8b60426f2332"}]}} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:05:41.455909 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.network.neutron [None req-a095934b-fdf7-4db3-babd-1b4ebddf483e tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] validate_networks() for [('11bba4c6-eed3-44ef-bcb5-8b60426f2332', None, None, None, None, None)] {{(pid=117850) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:05:41.918236 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-a095934b-fdf7-4db3-babd-1b4ebddf483e tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Flavor limits 0:0:0 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:05:41.918710 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-a095934b-fdf7-4db3-babd-1b4ebddf483e tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Image limits 0:0:0 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:05:41.919212 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-a095934b-fdf7-4db3-babd-1b4ebddf483e tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Flavor pref 0:0:0 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:05:41.919616 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-a095934b-fdf7-4db3-babd-1b4ebddf483e tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Image pref 0:0:0 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:05:41.920055 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-a095934b-fdf7-4db3-babd-1b4ebddf483e tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:05:41.929846 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-a095934b-fdf7-4db3-babd-1b4ebddf483e tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:41.930297 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-a095934b-fdf7-4db3-babd-1b4ebddf483e tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:41.931145 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-a095934b-fdf7-4db3-babd-1b4ebddf483e tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:41.931617 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-a095934b-fdf7-4db3-babd-1b4ebddf483e tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:41.949086 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.quota [None req-a095934b-fdf7-4db3-babd-1b4ebddf483e tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Getting quotas for project 0e52189be8d24c9894ef05cc7acf367c. Resources: {'cores', 'ram', 'instances'} {{(pid=117850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:05:41.953593 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.quota [None req-a095934b-fdf7-4db3-babd-1b4ebddf483e tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Getting quotas for user 922a970a740444a2959c6aa1d0921ee7 and project 0e52189be8d24c9894ef05cc7acf367c. Resources: {'cores', 'ram', 'instances'} {{(pid=117850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:05:42.014203 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-a095934b-fdf7-4db3-babd-1b4ebddf483e tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Going to run 1 instances... {{(pid=117850) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:05:42.016416 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-a095934b-fdf7-4db3-babd-1b4ebddf483e tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: 0052d136-dd29-43bf-a063-487cc87fd84d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='387f10a2-dc85-4824-b031-a1aa7eefadaf',volume_size=None,volume_type=None)] {{(pid=117850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:05:42.129263 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-2f739266-e831-4581-aab3-2dcd99ba44ad tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:42.129918 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-2f739266-e831-4581-aab3-2dcd99ba44ad tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:42.136833 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-2f739266-e831-4581-aab3-2dcd99ba44ad tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:42.137406 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-2f739266-e831-4581-aab3-2dcd99ba44ad tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:42.138188 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-2f739266-e831-4581-aab3-2dcd99ba44ad tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:42.138650 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-2f739266-e831-4581-aab3-2dcd99ba44ad tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:42.152135 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-a095934b-fdf7-4db3-babd-1b4ebddf483e tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.815150 Jun 16 19:05:42.152955 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 391/798] 10.222.0.70 () {60 vars in 1146 bytes} [Thu Jun 16 19:05:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 816 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:05:42.162887 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-fe8f50d0-621a-4524-bc86-19e7f566c35c tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:42.163507 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-fe8f50d0-621a-4524-bc86-19e7f566c35c tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: 0052d136-dd29-43bf-a063-487cc87fd84d] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:42.227080 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-fe8f50d0-621a-4524-bc86-19e7f566c35c tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:42.236472 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-fe8f50d0-621a-4524-bc86-19e7f566c35c tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/0052d136-dd29-43bf-a063-487cc87fd84d" status: 200 len: 1092 microversion: 2.1 time: 0.076169 Jun 16 19:05:42.243252 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 392/799] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:42 2022] GET /compute/v2.1/servers/0052d136-dd29-43bf-a063-487cc87fd84d => generated 1092 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:05:42.312006 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-2f739266-e831-4581-aab3-2dcd99ba44ad tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:42.320933 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-2f739266-e831-4581-aab3-2dcd99ba44ad tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:42.322471 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-2f739266-e831-4581-aab3-2dcd99ba44ad tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:42.323695 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-2f739266-e831-4581-aab3-2dcd99ba44ad tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 200 len: 1725 microversion: 2.20 time: 0.199240 Jun 16 19:05:42.324237 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 408/800] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:05:42 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 1725 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:05:43.257653 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-29444d38-983c-4ca5-b2e0-86ae3e841cd5 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:43.258258 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-29444d38-983c-4ca5-b2e0-86ae3e841cd5 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: 0052d136-dd29-43bf-a063-487cc87fd84d] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:43.265434 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-29444d38-983c-4ca5-b2e0-86ae3e841cd5 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:43.265882 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-29444d38-983c-4ca5-b2e0-86ae3e841cd5 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:43.266763 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-29444d38-983c-4ca5-b2e0-86ae3e841cd5 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:43.267888 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-29444d38-983c-4ca5-b2e0-86ae3e841cd5 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:43.342262 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-c44c68ad-e328-479a-96c2-e165a4b85617 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:43.343738 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-c44c68ad-e328-479a-96c2-e165a4b85617 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:43.346815 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-29444d38-983c-4ca5-b2e0-86ae3e841cd5 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:43.352545 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-c44c68ad-e328-479a-96c2-e165a4b85617 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:43.353240 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-c44c68ad-e328-479a-96c2-e165a4b85617 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:43.354246 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-c44c68ad-e328-479a-96c2-e165a4b85617 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:43.354918 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-c44c68ad-e328-479a-96c2-e165a4b85617 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:43.355905 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-29444d38-983c-4ca5-b2e0-86ae3e841cd5 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/0052d136-dd29-43bf-a063-487cc87fd84d" status: 200 len: 1208 microversion: 2.1 time: 0.101915 Jun 16 19:05:43.366722 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 393/801] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:43 2022] GET /compute/v2.1/servers/0052d136-dd29-43bf-a063-487cc87fd84d => generated 1208 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:43.515597 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-c44c68ad-e328-479a-96c2-e165a4b85617 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:43.525568 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-c44c68ad-e328-479a-96c2-e165a4b85617 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:43.527268 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-c44c68ad-e328-479a-96c2-e165a4b85617 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:43.528632 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-c44c68ad-e328-479a-96c2-e165a4b85617 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 200 len: 1725 microversion: 2.20 time: 0.190535 Jun 16 19:05:43.529361 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 409/802] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:05:43 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 1725 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:05:44.373315 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-f2f1c0cd-dcdb-42da-9c0f-0d7aae9c9fb0 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:44.373937 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-f2f1c0cd-dcdb-42da-9c0f-0d7aae9c9fb0 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: 0052d136-dd29-43bf-a063-487cc87fd84d] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:44.381052 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-f2f1c0cd-dcdb-42da-9c0f-0d7aae9c9fb0 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:44.381509 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-f2f1c0cd-dcdb-42da-9c0f-0d7aae9c9fb0 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:44.382286 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-f2f1c0cd-dcdb-42da-9c0f-0d7aae9c9fb0 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:44.382771 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-f2f1c0cd-dcdb-42da-9c0f-0d7aae9c9fb0 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:44.550075 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-c2d55f3d-3618-4a6a-86d7-16980a3cc3a3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:44.550796 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-c2d55f3d-3618-4a6a-86d7-16980a3cc3a3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:44.560995 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-c2d55f3d-3618-4a6a-86d7-16980a3cc3a3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:44.561521 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-c2d55f3d-3618-4a6a-86d7-16980a3cc3a3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:44.562375 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-c2d55f3d-3618-4a6a-86d7-16980a3cc3a3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:44.563080 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-c2d55f3d-3618-4a6a-86d7-16980a3cc3a3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:44.623719 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-f2f1c0cd-dcdb-42da-9c0f-0d7aae9c9fb0 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:44.632995 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-f2f1c0cd-dcdb-42da-9c0f-0d7aae9c9fb0 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/0052d136-dd29-43bf-a063-487cc87fd84d" status: 200 len: 1264 microversion: 2.1 time: 0.263334 Jun 16 19:05:44.634174 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 394/803] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:44 2022] GET /compute/v2.1/servers/0052d136-dd29-43bf-a063-487cc87fd84d => generated 1264 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:44.727614 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-c2d55f3d-3618-4a6a-86d7-16980a3cc3a3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:44.736218 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-c2d55f3d-3618-4a6a-86d7-16980a3cc3a3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:44.737991 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-c2d55f3d-3618-4a6a-86d7-16980a3cc3a3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:44.739980 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-c2d55f3d-3618-4a6a-86d7-16980a3cc3a3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 200 len: 1725 microversion: 2.20 time: 0.195100 Jun 16 19:05:44.740755 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 410/804] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:05:44 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 1725 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:05:44.820360 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [req-c7f7013f-d966-4911-a548-889ca12f190b req-62152750-bb36-4d09-970a-d11fe60def92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0052d136-dd29-43bf-a063-487cc87fd84d", "tag": "9f4f9c02-22f2-4c20-a150-09014370754f"}]} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:05:44.830971 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-c7f7013f-d966-4911-a548-889ca12f190b req-62152750-bb36-4d09-970a-d11fe60def92 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:44.843298 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-c7f7013f-d966-4911-a548-889ca12f190b req-62152750-bb36-4d09-970a-d11fe60def92 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:44.858603 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.compute.server_external_events [req-c7f7013f-d966-4911-a548-889ca12f190b req-62152750-bb36-4d09-970a-d11fe60def92 service nova] Creating event network-changed:9f4f9c02-22f2-4c20-a150-09014370754f for instance 0052d136-dd29-43bf-a063-487cc87fd84d on hv-cinder-84617 Jun 16 19:05:44.864795 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [req-c7f7013f-d966-4911-a548-889ca12f190b req-62152750-bb36-4d09-970a-d11fe60def92 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059079 Jun 16 19:05:44.866056 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 395/805] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:05:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:05:45.650679 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-bb90aac0-073f-487b-8cb3-ce99dde7ec13 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:45.651915 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-bb90aac0-073f-487b-8cb3-ce99dde7ec13 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: 0052d136-dd29-43bf-a063-487cc87fd84d] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:45.659284 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-bb90aac0-073f-487b-8cb3-ce99dde7ec13 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:45.660045 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-bb90aac0-073f-487b-8cb3-ce99dde7ec13 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:45.660845 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-bb90aac0-073f-487b-8cb3-ce99dde7ec13 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:45.661275 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-bb90aac0-073f-487b-8cb3-ce99dde7ec13 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:45.759137 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-994b78db-82b4-479a-92a4-fee38d6eb61d tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:45.759853 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-994b78db-82b4-479a-92a4-fee38d6eb61d tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:45.769332 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-994b78db-82b4-479a-92a4-fee38d6eb61d tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:45.769784 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-994b78db-82b4-479a-92a4-fee38d6eb61d tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:45.770603 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-994b78db-82b4-479a-92a4-fee38d6eb61d tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:45.771054 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-994b78db-82b4-479a-92a4-fee38d6eb61d tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:45.819555 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-bb90aac0-073f-487b-8cb3-ce99dde7ec13 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:45.827501 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-bb90aac0-073f-487b-8cb3-ce99dde7ec13 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/0052d136-dd29-43bf-a063-487cc87fd84d" status: 200 len: 1264 microversion: 2.1 time: 0.181134 Jun 16 19:05:45.828126 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 411/806] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:45 2022] GET /compute/v2.1/servers/0052d136-dd29-43bf-a063-487cc87fd84d => generated 1264 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:46.152601 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-994b78db-82b4-479a-92a4-fee38d6eb61d tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:46.156116 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:05:46.163009 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-994b78db-82b4-479a-92a4-fee38d6eb61d tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:46.164444 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-994b78db-82b4-479a-92a4-fee38d6eb61d tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:46.165656 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-994b78db-82b4-479a-92a4-fee38d6eb61d tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 200 len: 1725 microversion: 2.20 time: 0.410883 Jun 16 19:05:46.166212 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 396/807] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:05:45 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 1725 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:05:46.845418 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-5eba6d29-21bf-4563-b50a-ceb437abf6b0 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:46.846045 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-5eba6d29-21bf-4563-b50a-ceb437abf6b0 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: 0052d136-dd29-43bf-a063-487cc87fd84d] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:46.852640 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-5eba6d29-21bf-4563-b50a-ceb437abf6b0 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:46.853090 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-5eba6d29-21bf-4563-b50a-ceb437abf6b0 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:46.853857 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-5eba6d29-21bf-4563-b50a-ceb437abf6b0 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:46.854300 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-5eba6d29-21bf-4563-b50a-ceb437abf6b0 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:46.988182 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-5eba6d29-21bf-4563-b50a-ceb437abf6b0 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:46.995555 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-5eba6d29-21bf-4563-b50a-ceb437abf6b0 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/0052d136-dd29-43bf-a063-487cc87fd84d" status: 200 len: 1264 microversion: 2.1 time: 0.154634 Jun 16 19:05:46.996106 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 412/808] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:46 2022] GET /compute/v2.1/servers/0052d136-dd29-43bf-a063-487cc87fd84d => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:47.185041 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-cb9d9f73-d92a-498a-9a7d-ea8aa283ab0b tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:47.185654 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-cb9d9f73-d92a-498a-9a7d-ea8aa283ab0b tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:47.193673 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-cb9d9f73-d92a-498a-9a7d-ea8aa283ab0b tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:47.194123 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-cb9d9f73-d92a-498a-9a7d-ea8aa283ab0b tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:47.194936 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-cb9d9f73-d92a-498a-9a7d-ea8aa283ab0b tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:47.195374 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-cb9d9f73-d92a-498a-9a7d-ea8aa283ab0b tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:47.332354 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-cb9d9f73-d92a-498a-9a7d-ea8aa283ab0b tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:47.340494 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-cb9d9f73-d92a-498a-9a7d-ea8aa283ab0b tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:47.341988 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-cb9d9f73-d92a-498a-9a7d-ea8aa283ab0b tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:47.343172 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-cb9d9f73-d92a-498a-9a7d-ea8aa283ab0b tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 200 len: 1725 microversion: 2.20 time: 0.162131 Jun 16 19:05:47.343735 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 397/809] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:05:47 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:05:48.013038 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-f6f3f2e5-26a5-4b32-962e-09720d6001aa tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:48.013654 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-f6f3f2e5-26a5-4b32-962e-09720d6001aa tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: 0052d136-dd29-43bf-a063-487cc87fd84d] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:48.020817 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f6f3f2e5-26a5-4b32-962e-09720d6001aa tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:48.021264 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f6f3f2e5-26a5-4b32-962e-09720d6001aa tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:48.022025 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f6f3f2e5-26a5-4b32-962e-09720d6001aa tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:48.022458 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f6f3f2e5-26a5-4b32-962e-09720d6001aa tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:48.158937 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-f6f3f2e5-26a5-4b32-962e-09720d6001aa tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:48.166241 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-f6f3f2e5-26a5-4b32-962e-09720d6001aa tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/0052d136-dd29-43bf-a063-487cc87fd84d" status: 200 len: 1264 microversion: 2.1 time: 0.157250 Jun 16 19:05:48.166824 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 413/810] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:48 2022] GET /compute/v2.1/servers/0052d136-dd29-43bf-a063-487cc87fd84d => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:48.362840 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-683001e9-862c-4498-9bc5-cba6d1aa7016 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:48.363364 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-683001e9-862c-4498-9bc5-cba6d1aa7016 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:48.369829 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-683001e9-862c-4498-9bc5-cba6d1aa7016 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:48.370282 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-683001e9-862c-4498-9bc5-cba6d1aa7016 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:48.371071 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-683001e9-862c-4498-9bc5-cba6d1aa7016 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:48.371512 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-683001e9-862c-4498-9bc5-cba6d1aa7016 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:48.501468 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-683001e9-862c-4498-9bc5-cba6d1aa7016 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:48.509383 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-683001e9-862c-4498-9bc5-cba6d1aa7016 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:48.510947 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-683001e9-862c-4498-9bc5-cba6d1aa7016 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:48.512113 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-683001e9-862c-4498-9bc5-cba6d1aa7016 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 200 len: 1725 microversion: 2.20 time: 0.154346 Jun 16 19:05:48.512675 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 398/811] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:05:48 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:05:49.183915 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-40df0ed4-71ed-4ca1-b26b-82b21ebec11d tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:49.184643 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-40df0ed4-71ed-4ca1-b26b-82b21ebec11d tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: 0052d136-dd29-43bf-a063-487cc87fd84d] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:49.188881 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:05:49.193255 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-40df0ed4-71ed-4ca1-b26b-82b21ebec11d tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:49.193713 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-40df0ed4-71ed-4ca1-b26b-82b21ebec11d tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:49.194487 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-40df0ed4-71ed-4ca1-b26b-82b21ebec11d tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:49.194951 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-40df0ed4-71ed-4ca1-b26b-82b21ebec11d tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:49.327936 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-40df0ed4-71ed-4ca1-b26b-82b21ebec11d tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:49.337032 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-40df0ed4-71ed-4ca1-b26b-82b21ebec11d tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/0052d136-dd29-43bf-a063-487cc87fd84d" status: 200 len: 1264 microversion: 2.1 time: 0.156942 Jun 16 19:05:49.337594 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 414/812] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:49 2022] GET /compute/v2.1/servers/0052d136-dd29-43bf-a063-487cc87fd84d => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:49.531942 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-c37bb89e-4a2b-4878-85fe-e9f701d5509a tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:49.532653 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-c37bb89e-4a2b-4878-85fe-e9f701d5509a tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:49.540033 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-c37bb89e-4a2b-4878-85fe-e9f701d5509a tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:49.540493 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-c37bb89e-4a2b-4878-85fe-e9f701d5509a tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:49.541261 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-c37bb89e-4a2b-4878-85fe-e9f701d5509a tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:49.541740 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-c37bb89e-4a2b-4878-85fe-e9f701d5509a tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:49.676775 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-c37bb89e-4a2b-4878-85fe-e9f701d5509a tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:49.684667 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-c37bb89e-4a2b-4878-85fe-e9f701d5509a tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:49.686169 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-c37bb89e-4a2b-4878-85fe-e9f701d5509a tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:49.687359 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-c37bb89e-4a2b-4878-85fe-e9f701d5509a tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 200 len: 1725 microversion: 2.20 time: 0.160159 Jun 16 19:05:49.687915 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 399/813] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:05:49 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:05:50.359523 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-eaeab1a7-fa17-4402-90a9-6102f8163dcc tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:50.360078 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-eaeab1a7-fa17-4402-90a9-6102f8163dcc tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: 0052d136-dd29-43bf-a063-487cc87fd84d] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:50.367562 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-eaeab1a7-fa17-4402-90a9-6102f8163dcc tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:50.368002 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-eaeab1a7-fa17-4402-90a9-6102f8163dcc tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:50.368760 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-eaeab1a7-fa17-4402-90a9-6102f8163dcc tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:50.369194 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-eaeab1a7-fa17-4402-90a9-6102f8163dcc tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:50.510997 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-eaeab1a7-fa17-4402-90a9-6102f8163dcc tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:50.518691 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-eaeab1a7-fa17-4402-90a9-6102f8163dcc tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/0052d136-dd29-43bf-a063-487cc87fd84d" status: 200 len: 1264 microversion: 2.1 time: 0.163094 Jun 16 19:05:50.519254 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 415/814] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:50 2022] GET /compute/v2.1/servers/0052d136-dd29-43bf-a063-487cc87fd84d => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:50.707751 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-f32de392-1479-4c7f-95e5-35c8492ba90c tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:50.708360 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-f32de392-1479-4c7f-95e5-35c8492ba90c tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:50.710690 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:05:50.715919 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-f32de392-1479-4c7f-95e5-35c8492ba90c tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:50.716366 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-f32de392-1479-4c7f-95e5-35c8492ba90c tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:50.717123 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-f32de392-1479-4c7f-95e5-35c8492ba90c tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:50.717557 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-f32de392-1479-4c7f-95e5-35c8492ba90c tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:50.857572 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-f32de392-1479-4c7f-95e5-35c8492ba90c tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:50.866398 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-f32de392-1479-4c7f-95e5-35c8492ba90c tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:50.868068 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-f32de392-1479-4c7f-95e5-35c8492ba90c tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:50.869435 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-f32de392-1479-4c7f-95e5-35c8492ba90c tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 200 len: 1725 microversion: 2.20 time: 0.166283 Jun 16 19:05:50.870094 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 400/815] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:05:50 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:05:51.536073 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-e8a4a83f-bf4a-4634-aa63-9a2403c0d9c0 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:51.536690 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-e8a4a83f-bf4a-4634-aa63-9a2403c0d9c0 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: 0052d136-dd29-43bf-a063-487cc87fd84d] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:51.543063 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-e8a4a83f-bf4a-4634-aa63-9a2403c0d9c0 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:51.543504 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-e8a4a83f-bf4a-4634-aa63-9a2403c0d9c0 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:51.544250 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-e8a4a83f-bf4a-4634-aa63-9a2403c0d9c0 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:51.544678 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-e8a4a83f-bf4a-4634-aa63-9a2403c0d9c0 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:51.831127 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-e8a4a83f-bf4a-4634-aa63-9a2403c0d9c0 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:51.838503 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-e8a4a83f-bf4a-4634-aa63-9a2403c0d9c0 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/0052d136-dd29-43bf-a063-487cc87fd84d" status: 200 len: 1264 microversion: 2.1 time: 0.306468 Jun 16 19:05:51.839088 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 416/816] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:51 2022] GET /compute/v2.1/servers/0052d136-dd29-43bf-a063-487cc87fd84d => generated 1264 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:51.888193 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-86841c29-b0e1-4407-b437-acecc4df96f2 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:51.889010 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-86841c29-b0e1-4407-b437-acecc4df96f2 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:51.895659 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-86841c29-b0e1-4407-b437-acecc4df96f2 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:51.896122 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-86841c29-b0e1-4407-b437-acecc4df96f2 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:51.896891 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-86841c29-b0e1-4407-b437-acecc4df96f2 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:51.897334 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-86841c29-b0e1-4407-b437-acecc4df96f2 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:51.940270 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_cell0:SELECT=2 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:05:52.027613 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-86841c29-b0e1-4407-b437-acecc4df96f2 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:52.035715 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-86841c29-b0e1-4407-b437-acecc4df96f2 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:52.037208 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-86841c29-b0e1-4407-b437-acecc4df96f2 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:52.038356 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-86841c29-b0e1-4407-b437-acecc4df96f2 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 200 len: 1725 microversion: 2.20 time: 0.154145 Jun 16 19:05:52.038941 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 401/817] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:05:51 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:05:52.855605 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-2aa57684-b951-4767-9853-389000943248 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:52.856147 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-2aa57684-b951-4767-9853-389000943248 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: 0052d136-dd29-43bf-a063-487cc87fd84d] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:52.865027 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-2aa57684-b951-4767-9853-389000943248 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:52.865027 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-2aa57684-b951-4767-9853-389000943248 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:52.865682 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-2aa57684-b951-4767-9853-389000943248 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:52.866125 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-2aa57684-b951-4767-9853-389000943248 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:53.025964 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-2aa57684-b951-4767-9853-389000943248 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:53.035253 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-2aa57684-b951-4767-9853-389000943248 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/0052d136-dd29-43bf-a063-487cc87fd84d" status: 200 len: 1264 microversion: 2.1 time: 0.183700 Jun 16 19:05:53.035804 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 417/818] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:52 2022] GET /compute/v2.1/servers/0052d136-dd29-43bf-a063-487cc87fd84d => generated 1264 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:53.060127 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-da92aa27-1bd4-446b-b71e-dfc14418b48f tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:53.060839 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-da92aa27-1bd4-446b-b71e-dfc14418b48f tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:53.063824 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_cell0:SELECT=8 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:05:53.074208 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-da92aa27-1bd4-446b-b71e-dfc14418b48f tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:53.074695 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-da92aa27-1bd4-446b-b71e-dfc14418b48f tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:53.076045 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-da92aa27-1bd4-446b-b71e-dfc14418b48f tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:53.076792 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-da92aa27-1bd4-446b-b71e-dfc14418b48f tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:53.237354 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-da92aa27-1bd4-446b-b71e-dfc14418b48f tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:53.247345 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-da92aa27-1bd4-446b-b71e-dfc14418b48f tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:53.249197 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-da92aa27-1bd4-446b-b71e-dfc14418b48f tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:53.250417 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-da92aa27-1bd4-446b-b71e-dfc14418b48f tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 200 len: 1725 microversion: 2.20 time: 0.196261 Jun 16 19:05:53.251181 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 402/819] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:05:53 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 1725 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:05:54.051812 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-c29e950a-a01a-417b-a30d-a59c007f0ece tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:54.052442 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-c29e950a-a01a-417b-a30d-a59c007f0ece tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: 0052d136-dd29-43bf-a063-487cc87fd84d] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:54.058928 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-c29e950a-a01a-417b-a30d-a59c007f0ece tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:54.059370 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-c29e950a-a01a-417b-a30d-a59c007f0ece tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:54.060126 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-c29e950a-a01a-417b-a30d-a59c007f0ece tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:54.060577 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-c29e950a-a01a-417b-a30d-a59c007f0ece tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:54.191807 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-c29e950a-a01a-417b-a30d-a59c007f0ece tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:54.199344 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-c29e950a-a01a-417b-a30d-a59c007f0ece tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/0052d136-dd29-43bf-a063-487cc87fd84d" status: 200 len: 1264 microversion: 2.1 time: 0.152004 Jun 16 19:05:54.199893 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 418/820] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:54 2022] GET /compute/v2.1/servers/0052d136-dd29-43bf-a063-487cc87fd84d => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:54.273416 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-ec6a6632-c862-4dc5-9021-5a1a0aded22c tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:54.274030 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-ec6a6632-c862-4dc5-9021-5a1a0aded22c tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:54.280806 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-ec6a6632-c862-4dc5-9021-5a1a0aded22c tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:54.281259 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-ec6a6632-c862-4dc5-9021-5a1a0aded22c tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:54.282827 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-ec6a6632-c862-4dc5-9021-5a1a0aded22c tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:54.283289 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-ec6a6632-c862-4dc5-9021-5a1a0aded22c tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:54.417655 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-ec6a6632-c862-4dc5-9021-5a1a0aded22c tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:54.426609 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-ec6a6632-c862-4dc5-9021-5a1a0aded22c tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:54.428128 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-ec6a6632-c862-4dc5-9021-5a1a0aded22c tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:54.429304 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-ec6a6632-c862-4dc5-9021-5a1a0aded22c tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 200 len: 1725 microversion: 2.20 time: 0.159894 Jun 16 19:05:54.429917 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 403/821] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:05:54 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:05:55.216741 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-0ad3e44c-a039-4c40-a373-cee50821aa6c tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:55.217295 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-0ad3e44c-a039-4c40-a373-cee50821aa6c tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: 0052d136-dd29-43bf-a063-487cc87fd84d] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:55.224015 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-0ad3e44c-a039-4c40-a373-cee50821aa6c tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:55.224471 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-0ad3e44c-a039-4c40-a373-cee50821aa6c tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:55.225273 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-0ad3e44c-a039-4c40-a373-cee50821aa6c tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:55.225707 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-0ad3e44c-a039-4c40-a373-cee50821aa6c tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:55.359457 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-0ad3e44c-a039-4c40-a373-cee50821aa6c tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:55.368279 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-0ad3e44c-a039-4c40-a373-cee50821aa6c tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/0052d136-dd29-43bf-a063-487cc87fd84d" status: 200 len: 1264 microversion: 2.1 time: 0.155438 Jun 16 19:05:55.368832 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 419/822] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:55 2022] GET /compute/v2.1/servers/0052d136-dd29-43bf-a063-487cc87fd84d => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:05:55.447928 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-df68d2b9-a895-40ee-afe6-4dba721a96b3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:55.448587 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-df68d2b9-a895-40ee-afe6-4dba721a96b3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:55.456115 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-df68d2b9-a895-40ee-afe6-4dba721a96b3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:55.456588 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-df68d2b9-a895-40ee-afe6-4dba721a96b3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:55.457393 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-df68d2b9-a895-40ee-afe6-4dba721a96b3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:55.457841 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-df68d2b9-a895-40ee-afe6-4dba721a96b3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:55.592937 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-df68d2b9-a895-40ee-afe6-4dba721a96b3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:55.602058 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-df68d2b9-a895-40ee-afe6-4dba721a96b3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:55.603592 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-df68d2b9-a895-40ee-afe6-4dba721a96b3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:55.604751 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-df68d2b9-a895-40ee-afe6-4dba721a96b3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 200 len: 1725 microversion: 2.20 time: 0.160936 Jun 16 19:05:55.605311 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 404/823] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:05:55 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:05:56.385630 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-735e5869-2330-4b56-8f01-f180c566124b tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:56.386205 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-735e5869-2330-4b56-8f01-f180c566124b tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: 0052d136-dd29-43bf-a063-487cc87fd84d] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:56.393418 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-735e5869-2330-4b56-8f01-f180c566124b tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:56.393924 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-735e5869-2330-4b56-8f01-f180c566124b tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:56.394839 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-735e5869-2330-4b56-8f01-f180c566124b tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:56.395323 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-735e5869-2330-4b56-8f01-f180c566124b tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:56.552067 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-735e5869-2330-4b56-8f01-f180c566124b tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:56.560107 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-735e5869-2330-4b56-8f01-f180c566124b tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/0052d136-dd29-43bf-a063-487cc87fd84d" status: 200 len: 1264 microversion: 2.1 time: 0.178725 Jun 16 19:05:56.560666 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 420/824] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:56 2022] GET /compute/v2.1/servers/0052d136-dd29-43bf-a063-487cc87fd84d => generated 1264 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:56.623572 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-b58d1691-c4c3-49cb-8c0c-6815b3709ebe tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:56.624224 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-b58d1691-c4c3-49cb-8c0c-6815b3709ebe tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:56.631217 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b58d1691-c4c3-49cb-8c0c-6815b3709ebe tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:56.631671 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b58d1691-c4c3-49cb-8c0c-6815b3709ebe tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:56.632434 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b58d1691-c4c3-49cb-8c0c-6815b3709ebe tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:56.632873 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b58d1691-c4c3-49cb-8c0c-6815b3709ebe tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:56.766208 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-b58d1691-c4c3-49cb-8c0c-6815b3709ebe tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:56.774319 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-b58d1691-c4c3-49cb-8c0c-6815b3709ebe tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:56.776093 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-b58d1691-c4c3-49cb-8c0c-6815b3709ebe tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:56.777251 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-b58d1691-c4c3-49cb-8c0c-6815b3709ebe tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 200 len: 1725 microversion: 2.20 time: 0.157605 Jun 16 19:05:56.777800 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 405/825] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:05:56 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:05:57.577479 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-b6fcad4b-ee76-4760-8308-91d9cae290a4 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:57.578102 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-b6fcad4b-ee76-4760-8308-91d9cae290a4 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: 0052d136-dd29-43bf-a063-487cc87fd84d] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:57.584926 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-b6fcad4b-ee76-4760-8308-91d9cae290a4 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:57.585385 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-b6fcad4b-ee76-4760-8308-91d9cae290a4 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:57.586233 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-b6fcad4b-ee76-4760-8308-91d9cae290a4 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:57.586725 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-b6fcad4b-ee76-4760-8308-91d9cae290a4 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:57.718736 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-b6fcad4b-ee76-4760-8308-91d9cae290a4 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:57.727119 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-b6fcad4b-ee76-4760-8308-91d9cae290a4 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/0052d136-dd29-43bf-a063-487cc87fd84d" status: 200 len: 1264 microversion: 2.1 time: 0.153605 Jun 16 19:05:57.727661 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 421/826] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:57 2022] GET /compute/v2.1/servers/0052d136-dd29-43bf-a063-487cc87fd84d => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:57.796904 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-29cb97e7-774e-49c1-8144-fb9630024719 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:57.797529 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-29cb97e7-774e-49c1-8144-fb9630024719 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:57.804549 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-29cb97e7-774e-49c1-8144-fb9630024719 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:57.805001 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-29cb97e7-774e-49c1-8144-fb9630024719 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:57.805769 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-29cb97e7-774e-49c1-8144-fb9630024719 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:57.806206 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-29cb97e7-774e-49c1-8144-fb9630024719 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:57.942666 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-29cb97e7-774e-49c1-8144-fb9630024719 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:57.950921 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-29cb97e7-774e-49c1-8144-fb9630024719 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:57.952431 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-29cb97e7-774e-49c1-8144-fb9630024719 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:57.954163 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-29cb97e7-774e-49c1-8144-fb9630024719 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 200 len: 1725 microversion: 2.20 time: 0.160851 Jun 16 19:05:57.954810 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 406/827] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:05:57 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:05:58.743067 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-da5d675a-173f-4da2-a278-97747a2793f9 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:58.743699 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-da5d675a-173f-4da2-a278-97747a2793f9 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: 0052d136-dd29-43bf-a063-487cc87fd84d] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:58.750382 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-da5d675a-173f-4da2-a278-97747a2793f9 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:58.751616 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-da5d675a-173f-4da2-a278-97747a2793f9 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:58.752395 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-da5d675a-173f-4da2-a278-97747a2793f9 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:58.752831 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-da5d675a-173f-4da2-a278-97747a2793f9 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:58.889286 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-da5d675a-173f-4da2-a278-97747a2793f9 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:58.896789 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-da5d675a-173f-4da2-a278-97747a2793f9 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/0052d136-dd29-43bf-a063-487cc87fd84d" status: 200 len: 1264 microversion: 2.1 time: 0.157776 Jun 16 19:05:58.897339 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 422/828] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:58 2022] GET /compute/v2.1/servers/0052d136-dd29-43bf-a063-487cc87fd84d => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:05:58.972766 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-b75cca3c-badf-4d21-ac70-290243098312 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:58.973371 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-b75cca3c-badf-4d21-ac70-290243098312 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:58.980115 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b75cca3c-badf-4d21-ac70-290243098312 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:58.980491 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b75cca3c-badf-4d21-ac70-290243098312 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:58.981250 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b75cca3c-badf-4d21-ac70-290243098312 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:58.981681 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b75cca3c-badf-4d21-ac70-290243098312 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:59.118126 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-b75cca3c-badf-4d21-ac70-290243098312 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:59.126285 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-b75cca3c-badf-4d21-ac70-290243098312 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:59.127895 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-b75cca3c-badf-4d21-ac70-290243098312 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:05:59.129180 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-b75cca3c-badf-4d21-ac70-290243098312 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 200 len: 1725 microversion: 2.20 time: 0.160800 Jun 16 19:05:59.129745 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 407/829] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:05:58 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:05:59.448723 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [req-871792ae-6452-43de-bf99-369c185550d7 req-4469d967-1b6b-405b-b273-3336eb050232 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0052d136-dd29-43bf-a063-487cc87fd84d", "name": "network-vif-plugged", "status": "completed", "tag": "9f4f9c02-22f2-4c20-a150-09014370754f"}]} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:05:59.457667 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-871792ae-6452-43de-bf99-369c185550d7 req-4469d967-1b6b-405b-b273-3336eb050232 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:59.458111 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-871792ae-6452-43de-bf99-369c185550d7 req-4469d967-1b6b-405b-b273-3336eb050232 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:59.471470 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.compute.server_external_events [req-871792ae-6452-43de-bf99-369c185550d7 req-4469d967-1b6b-405b-b273-3336eb050232 service nova] Creating event network-vif-plugged:9f4f9c02-22f2-4c20-a150-09014370754f for instance 0052d136-dd29-43bf-a063-487cc87fd84d on hv-cinder-84617 Jun 16 19:05:59.476576 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [req-871792ae-6452-43de-bf99-369c185550d7 req-4469d967-1b6b-405b-b273-3336eb050232 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031641 Jun 16 19:05:59.477274 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 423/830] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:05:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:05:59.913815 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-88fffd2b-e156-4033-a9a5-6e5b96b8762e tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:05:59.914517 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-88fffd2b-e156-4033-a9a5-6e5b96b8762e tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: 0052d136-dd29-43bf-a063-487cc87fd84d] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:05:59.920579 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-88fffd2b-e156-4033-a9a5-6e5b96b8762e tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:59.921074 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-88fffd2b-e156-4033-a9a5-6e5b96b8762e tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:05:59.921968 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-88fffd2b-e156-4033-a9a5-6e5b96b8762e tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:05:59.922448 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-88fffd2b-e156-4033-a9a5-6e5b96b8762e tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:00.067805 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-88fffd2b-e156-4033-a9a5-6e5b96b8762e tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:00.075842 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-88fffd2b-e156-4033-a9a5-6e5b96b8762e tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/0052d136-dd29-43bf-a063-487cc87fd84d" status: 200 len: 1264 microversion: 2.1 time: 0.165847 Jun 16 19:06:00.076405 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 408/831] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:05:59 2022] GET /compute/v2.1/servers/0052d136-dd29-43bf-a063-487cc87fd84d => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:06:00.149936 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-b2871e84-b0e5-4206-89e4-d544ac5aab15 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:00.150696 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-b2871e84-b0e5-4206-89e4-d544ac5aab15 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:00.156756 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-b2871e84-b0e5-4206-89e4-d544ac5aab15 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:00.157333 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-b2871e84-b0e5-4206-89e4-d544ac5aab15 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:00.158088 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-b2871e84-b0e5-4206-89e4-d544ac5aab15 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:00.158515 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-b2871e84-b0e5-4206-89e4-d544ac5aab15 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:00.292110 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-b2871e84-b0e5-4206-89e4-d544ac5aab15 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:00.295642 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_cell1:SELECT=100 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:06:00.302077 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-b2871e84-b0e5-4206-89e4-d544ac5aab15 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:00.303611 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-b2871e84-b0e5-4206-89e4-d544ac5aab15 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:00.304769 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-b2871e84-b0e5-4206-89e4-d544ac5aab15 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 200 len: 1725 microversion: 2.20 time: 0.160815 Jun 16 19:06:00.305313 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 424/832] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:06:00 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:06:01.092043 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-45d4b4be-3793-4fe5-a1f7-f684074e286e tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:01.092661 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-45d4b4be-3793-4fe5-a1f7-f684074e286e tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: 0052d136-dd29-43bf-a063-487cc87fd84d] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:01.099372 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-45d4b4be-3793-4fe5-a1f7-f684074e286e tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:01.099816 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-45d4b4be-3793-4fe5-a1f7-f684074e286e tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:01.100570 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-45d4b4be-3793-4fe5-a1f7-f684074e286e tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:01.101002 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-45d4b4be-3793-4fe5-a1f7-f684074e286e tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:01.243593 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-45d4b4be-3793-4fe5-a1f7-f684074e286e tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:01.252278 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-45d4b4be-3793-4fe5-a1f7-f684074e286e tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/0052d136-dd29-43bf-a063-487cc87fd84d" status: 200 len: 1264 microversion: 2.1 time: 0.164061 Jun 16 19:06:01.252882 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 409/833] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:06:01 2022] GET /compute/v2.1/servers/0052d136-dd29-43bf-a063-487cc87fd84d => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:06:01.325140 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-eb01eaf5-b0f3-4022-9f59-910a2eb5e170 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:01.325855 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-eb01eaf5-b0f3-4022-9f59-910a2eb5e170 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:01.334514 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-eb01eaf5-b0f3-4022-9f59-910a2eb5e170 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:01.335093 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-eb01eaf5-b0f3-4022-9f59-910a2eb5e170 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:01.335941 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-eb01eaf5-b0f3-4022-9f59-910a2eb5e170 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:01.336461 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-eb01eaf5-b0f3-4022-9f59-910a2eb5e170 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:01.479362 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-eb01eaf5-b0f3-4022-9f59-910a2eb5e170 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:01.488424 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-eb01eaf5-b0f3-4022-9f59-910a2eb5e170 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:01.489924 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-eb01eaf5-b0f3-4022-9f59-910a2eb5e170 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:01.491121 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-eb01eaf5-b0f3-4022-9f59-910a2eb5e170 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 200 len: 1725 microversion: 2.20 time: 0.170833 Jun 16 19:06:01.491663 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 425/834] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:06:01 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:06:02.269756 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-c56bfe36-fbd5-4220-8ff5-fad07d733e09 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:02.270374 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-c56bfe36-fbd5-4220-8ff5-fad07d733e09 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: 0052d136-dd29-43bf-a063-487cc87fd84d] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:02.277241 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-c56bfe36-fbd5-4220-8ff5-fad07d733e09 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:02.277690 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-c56bfe36-fbd5-4220-8ff5-fad07d733e09 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:02.278453 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-c56bfe36-fbd5-4220-8ff5-fad07d733e09 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:02.278922 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-c56bfe36-fbd5-4220-8ff5-fad07d733e09 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:02.414902 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-c56bfe36-fbd5-4220-8ff5-fad07d733e09 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:02.423000 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-c56bfe36-fbd5-4220-8ff5-fad07d733e09 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/0052d136-dd29-43bf-a063-487cc87fd84d" status: 200 len: 1451 microversion: 2.1 time: 0.157070 Jun 16 19:06:02.423791 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 410/835] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:06:02 2022] GET /compute/v2.1/servers/0052d136-dd29-43bf-a063-487cc87fd84d => generated 1451 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:06:02.441746 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-0ca624f7-2473-4281-a019-877329ed595e tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:02.442362 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-0ca624f7-2473-4281-a019-877329ed595e tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: 0052d136-dd29-43bf-a063-487cc87fd84d] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:02.448966 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-0ca624f7-2473-4281-a019-877329ed595e tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:02.449417 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-0ca624f7-2473-4281-a019-877329ed595e tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:02.450182 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-0ca624f7-2473-4281-a019-877329ed595e tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:02.450651 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-0ca624f7-2473-4281-a019-877329ed595e tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:02.509716 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-3debdf0f-fd7b-4a4b-85da-9429b7bf6206 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:02.510350 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-3debdf0f-fd7b-4a4b-85da-9429b7bf6206 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:02.521776 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-3debdf0f-fd7b-4a4b-85da-9429b7bf6206 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:02.522312 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-3debdf0f-fd7b-4a4b-85da-9429b7bf6206 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:02.523343 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-3debdf0f-fd7b-4a4b-85da-9429b7bf6206 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:02.523850 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-3debdf0f-fd7b-4a4b-85da-9429b7bf6206 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:02.597552 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-0ca624f7-2473-4281-a019-877329ed595e tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:02.605449 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-0ca624f7-2473-4281-a019-877329ed595e tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/0052d136-dd29-43bf-a063-487cc87fd84d" status: 200 len: 1451 microversion: 2.1 time: 0.168620 Jun 16 19:06:02.606380 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 426/836] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:06:02 2022] GET /compute/v2.1/servers/0052d136-dd29-43bf-a063-487cc87fd84d => generated 1451 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:06:02.680512 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-3debdf0f-fd7b-4a4b-85da-9429b7bf6206 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:02.690429 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-3debdf0f-fd7b-4a4b-85da-9429b7bf6206 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:02.692295 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-3debdf0f-fd7b-4a4b-85da-9429b7bf6206 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:02.693586 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-3debdf0f-fd7b-4a4b-85da-9429b7bf6206 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 200 len: 1725 microversion: 2.20 time: 0.188135 Jun 16 19:06:02.694240 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 411/837] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:06:02 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 1725 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:06:03.712433 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-9d51831c-86ba-4d27-8d38-a9ea70c9fedd tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:03.713041 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-9d51831c-86ba-4d27-8d38-a9ea70c9fedd tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:03.720272 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-9d51831c-86ba-4d27-8d38-a9ea70c9fedd tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:03.720851 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-9d51831c-86ba-4d27-8d38-a9ea70c9fedd tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:03.721618 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-9d51831c-86ba-4d27-8d38-a9ea70c9fedd tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:03.722043 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-9d51831c-86ba-4d27-8d38-a9ea70c9fedd tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:03.974943 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-9d51831c-86ba-4d27-8d38-a9ea70c9fedd tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:03.983037 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-9d51831c-86ba-4d27-8d38-a9ea70c9fedd tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:03.984714 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-9d51831c-86ba-4d27-8d38-a9ea70c9fedd tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:03.986086 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-9d51831c-86ba-4d27-8d38-a9ea70c9fedd tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 200 len: 1725 microversion: 2.20 time: 0.277698 Jun 16 19:06:03.986775 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 427/838] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:06:03 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 1725 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:06:04.749118 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [req-46d3f275-a2e8-4ebe-8f9a-1973b1f5dc10 req-5ae853ca-7344-4b2c-817f-99c2d8b0c4d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0052d136-dd29-43bf-a063-487cc87fd84d", "tag": "9f4f9c02-22f2-4c20-a150-09014370754f"}]} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:06:04.759076 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-46d3f275-a2e8-4ebe-8f9a-1973b1f5dc10 req-5ae853ca-7344-4b2c-817f-99c2d8b0c4d9 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:04.759607 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-46d3f275-a2e8-4ebe-8f9a-1973b1f5dc10 req-5ae853ca-7344-4b2c-817f-99c2d8b0c4d9 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:04.771878 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.compute.server_external_events [req-46d3f275-a2e8-4ebe-8f9a-1973b1f5dc10 req-5ae853ca-7344-4b2c-817f-99c2d8b0c4d9 service nova] Creating event network-changed:9f4f9c02-22f2-4c20-a150-09014370754f for instance 0052d136-dd29-43bf-a063-487cc87fd84d on hv-cinder-84617 Jun 16 19:06:04.777379 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [req-46d3f275-a2e8-4ebe-8f9a-1973b1f5dc10 req-5ae853ca-7344-4b2c-817f-99c2d8b0c4d9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153739 Jun 16 19:06:04.778065 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 412/839] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:06:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:06:05.004995 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-dc8ddb75-60af-4656-ae0f-39dbcf685dc0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:05.005719 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-dc8ddb75-60af-4656-ae0f-39dbcf685dc0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:05.012217 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-dc8ddb75-60af-4656-ae0f-39dbcf685dc0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:05.012673 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-dc8ddb75-60af-4656-ae0f-39dbcf685dc0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:05.013452 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-dc8ddb75-60af-4656-ae0f-39dbcf685dc0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:05.013894 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-dc8ddb75-60af-4656-ae0f-39dbcf685dc0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:05.149905 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-dc8ddb75-60af-4656-ae0f-39dbcf685dc0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:05.160126 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-dc8ddb75-60af-4656-ae0f-39dbcf685dc0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:05.161812 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-dc8ddb75-60af-4656-ae0f-39dbcf685dc0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:05.163492 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-dc8ddb75-60af-4656-ae0f-39dbcf685dc0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 200 len: 1746 microversion: 2.20 time: 0.162566 Jun 16 19:06:05.176325 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 428/840] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:06:04 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 1746 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:06:06.184469 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-6f75fe5e-1b16-4bb2-b8a8-972d04ac75b9 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:06.185177 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-6f75fe5e-1b16-4bb2-b8a8-972d04ac75b9 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:06.191603 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-6f75fe5e-1b16-4bb2-b8a8-972d04ac75b9 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:06.192062 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-6f75fe5e-1b16-4bb2-b8a8-972d04ac75b9 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:06.192838 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-6f75fe5e-1b16-4bb2-b8a8-972d04ac75b9 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:06.193277 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-6f75fe5e-1b16-4bb2-b8a8-972d04ac75b9 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:06.325296 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-6f75fe5e-1b16-4bb2-b8a8-972d04ac75b9 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:06.334341 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-6f75fe5e-1b16-4bb2-b8a8-972d04ac75b9 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:06.335902 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-6f75fe5e-1b16-4bb2-b8a8-972d04ac75b9 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:06.337053 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-6f75fe5e-1b16-4bb2-b8a8-972d04ac75b9 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 200 len: 1746 microversion: 2.20 time: 0.157413 Jun 16 19:06:06.337608 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 413/841] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:06:06 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 1746 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:06:07.355632 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-0573c009-293d-4779-813b-c7e71e482822 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:07.356246 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-0573c009-293d-4779-813b-c7e71e482822 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:07.363616 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-0573c009-293d-4779-813b-c7e71e482822 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:07.364070 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-0573c009-293d-4779-813b-c7e71e482822 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:07.364846 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-0573c009-293d-4779-813b-c7e71e482822 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:07.365286 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-0573c009-293d-4779-813b-c7e71e482822 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:07.498456 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-0573c009-293d-4779-813b-c7e71e482822 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:07.506484 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-0573c009-293d-4779-813b-c7e71e482822 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:07.508056 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-0573c009-293d-4779-813b-c7e71e482822 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:07.509214 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-0573c009-293d-4779-813b-c7e71e482822 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 200 len: 1746 microversion: 2.20 time: 0.157511 Jun 16 19:06:07.509771 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 429/842] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:06:07 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 1746 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:06:08.528920 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-ffd38ce2-225b-42bf-9b70-16bbe1148134 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:08.529531 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-ffd38ce2-225b-42bf-9b70-16bbe1148134 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:08.536206 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-ffd38ce2-225b-42bf-9b70-16bbe1148134 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:08.536650 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-ffd38ce2-225b-42bf-9b70-16bbe1148134 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:08.537409 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-ffd38ce2-225b-42bf-9b70-16bbe1148134 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:08.537840 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-ffd38ce2-225b-42bf-9b70-16bbe1148134 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:08.541863 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_cell1:SELECT=100 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:06:08.676627 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-ffd38ce2-225b-42bf-9b70-16bbe1148134 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:08.685321 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-ffd38ce2-225b-42bf-9b70-16bbe1148134 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:08.686221 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-ffd38ce2-225b-42bf-9b70-16bbe1148134 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:08.687440 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-ffd38ce2-225b-42bf-9b70-16bbe1148134 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 200 len: 1746 microversion: 2.20 time: 0.162397 Jun 16 19:06:08.688002 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 414/843] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:06:08 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 1746 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:06:09.013938 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [req-92f672e7-d507-47f8-be3d-b32001bacc16 req-aff9752b-d3b7-409b-8755-30db8e195dee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac8de877-3a07-4017-99fb-45b37ef123b6", "name": "network-vif-plugged", "status": "completed", "tag": "8bd9db24-3ac1-4beb-93fd-9cdfca791f22"}]} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:06:09.022553 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-92f672e7-d507-47f8-be3d-b32001bacc16 req-aff9752b-d3b7-409b-8755-30db8e195dee service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:09.023058 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-92f672e7-d507-47f8-be3d-b32001bacc16 req-aff9752b-d3b7-409b-8755-30db8e195dee service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:09.035266 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.compute.server_external_events [req-92f672e7-d507-47f8-be3d-b32001bacc16 req-aff9752b-d3b7-409b-8755-30db8e195dee service nova] Creating event network-vif-plugged:8bd9db24-3ac1-4beb-93fd-9cdfca791f22 for instance ac8de877-3a07-4017-99fb-45b37ef123b6 on hv-cinder-84617 Jun 16 19:06:09.040244 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [req-92f672e7-d507-47f8-be3d-b32001bacc16 req-aff9752b-d3b7-409b-8755-30db8e195dee service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030323 Jun 16 19:06:09.040825 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 430/844] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:06:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:06:09.707607 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-916ed894-6c06-437b-8d5f-64f961bd1880 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:09.708749 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-916ed894-6c06-437b-8d5f-64f961bd1880 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:09.716258 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-916ed894-6c06-437b-8d5f-64f961bd1880 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:09.716706 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-916ed894-6c06-437b-8d5f-64f961bd1880 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:09.717526 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-916ed894-6c06-437b-8d5f-64f961bd1880 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:09.717973 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-916ed894-6c06-437b-8d5f-64f961bd1880 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:09.867331 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-916ed894-6c06-437b-8d5f-64f961bd1880 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:09.877149 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-916ed894-6c06-437b-8d5f-64f961bd1880 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:09.878758 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-916ed894-6c06-437b-8d5f-64f961bd1880 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:09.880205 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-916ed894-6c06-437b-8d5f-64f961bd1880 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 200 len: 1741 microversion: 2.20 time: 0.178364 Jun 16 19:06:09.881256 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 415/845] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:06:09 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 1741 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:06:10.902059 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-8970a0dd-220a-40c3-83a6-20810c1c7e1e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:10.905558 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-8970a0dd-220a-40c3-83a6-20810c1c7e1e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:10.913404 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-8970a0dd-220a-40c3-83a6-20810c1c7e1e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:10.914010 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-8970a0dd-220a-40c3-83a6-20810c1c7e1e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:10.914924 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-8970a0dd-220a-40c3-83a6-20810c1c7e1e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:10.915461 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-8970a0dd-220a-40c3-83a6-20810c1c7e1e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:11.111385 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-8970a0dd-220a-40c3-83a6-20810c1c7e1e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:11.130954 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-8970a0dd-220a-40c3-83a6-20810c1c7e1e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:11.133273 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-8970a0dd-220a-40c3-83a6-20810c1c7e1e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:11.134555 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-8970a0dd-220a-40c3-83a6-20810c1c7e1e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 200 len: 1741 microversion: 2.20 time: 0.238260 Jun 16 19:06:11.146812 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 431/846] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:06:10 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 1741 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:06:12.153763 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-da9b7196-6379-49fb-a78c-ea61b415893a tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:12.154660 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-da9b7196-6379-49fb-a78c-ea61b415893a tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:12.167309 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-da9b7196-6379-49fb-a78c-ea61b415893a tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:12.167910 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-da9b7196-6379-49fb-a78c-ea61b415893a tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:12.168752 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-da9b7196-6379-49fb-a78c-ea61b415893a tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:12.169408 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-da9b7196-6379-49fb-a78c-ea61b415893a tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:12.313164 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-da9b7196-6379-49fb-a78c-ea61b415893a tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:12.322248 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-da9b7196-6379-49fb-a78c-ea61b415893a tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:12.323854 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-da9b7196-6379-49fb-a78c-ea61b415893a tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:12.325058 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-da9b7196-6379-49fb-a78c-ea61b415893a tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 200 len: 1741 microversion: 2.20 time: 0.175634 Jun 16 19:06:12.337173 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 416/847] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:06:12 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 1741 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:06:13.345814 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-2bbade7f-e9b2-4b64-9c59-37da0b426ea5 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:13.347075 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-2bbade7f-e9b2-4b64-9c59-37da0b426ea5 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:13.356219 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-2bbade7f-e9b2-4b64-9c59-37da0b426ea5 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:13.356661 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-2bbade7f-e9b2-4b64-9c59-37da0b426ea5 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:13.357433 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-2bbade7f-e9b2-4b64-9c59-37da0b426ea5 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:13.357861 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-2bbade7f-e9b2-4b64-9c59-37da0b426ea5 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:13.589506 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-2bbade7f-e9b2-4b64-9c59-37da0b426ea5 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:13.600861 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-2bbade7f-e9b2-4b64-9c59-37da0b426ea5 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:13.602749 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-2bbade7f-e9b2-4b64-9c59-37da0b426ea5 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:13.605428 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-2bbade7f-e9b2-4b64-9c59-37da0b426ea5 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 200 len: 1741 microversion: 2.20 time: 0.264481 Jun 16 19:06:13.606446 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 432/848] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:06:13 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 1741 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:06:14.624193 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-1b4efbe4-4383-4779-a27c-96ec77d3e18e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:14.624809 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-1b4efbe4-4383-4779-a27c-96ec77d3e18e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:14.633344 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-1b4efbe4-4383-4779-a27c-96ec77d3e18e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:14.633806 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-1b4efbe4-4383-4779-a27c-96ec77d3e18e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:14.634604 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-1b4efbe4-4383-4779-a27c-96ec77d3e18e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:14.635112 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-1b4efbe4-4383-4779-a27c-96ec77d3e18e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:14.889405 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-1b4efbe4-4383-4779-a27c-96ec77d3e18e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:14.903562 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-1b4efbe4-4383-4779-a27c-96ec77d3e18e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:14.905466 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-1b4efbe4-4383-4779-a27c-96ec77d3e18e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:14.909286 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-1b4efbe4-4383-4779-a27c-96ec77d3e18e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 200 len: 1741 microversion: 2.20 time: 0.289191 Jun 16 19:06:14.916689 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 417/849] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:06:14 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 1741 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:06:15.932879 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-1feddc02-22bf-4d35-99ca-6b8e6ca06e5e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:15.933586 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-1feddc02-22bf-4d35-99ca-6b8e6ca06e5e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:15.940829 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-1feddc02-22bf-4d35-99ca-6b8e6ca06e5e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:15.941723 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-1feddc02-22bf-4d35-99ca-6b8e6ca06e5e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:15.952610 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-1feddc02-22bf-4d35-99ca-6b8e6ca06e5e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:15.953887 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-1feddc02-22bf-4d35-99ca-6b8e6ca06e5e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:16.113988 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-1feddc02-22bf-4d35-99ca-6b8e6ca06e5e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:16.123070 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-1feddc02-22bf-4d35-99ca-6b8e6ca06e5e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:16.124905 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-1feddc02-22bf-4d35-99ca-6b8e6ca06e5e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:16.126550 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-1feddc02-22bf-4d35-99ca-6b8e6ca06e5e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 200 len: 1741 microversion: 2.20 time: 0.198241 Jun 16 19:06:16.127288 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 433/850] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:06:15 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 1741 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:06:17.146351 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-560ba228-b4e9-4f1d-8ca7-66199e33268d tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:17.147870 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-560ba228-b4e9-4f1d-8ca7-66199e33268d tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:17.163126 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-560ba228-b4e9-4f1d-8ca7-66199e33268d tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:17.163891 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-560ba228-b4e9-4f1d-8ca7-66199e33268d tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:17.164882 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-560ba228-b4e9-4f1d-8ca7-66199e33268d tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:17.165485 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-560ba228-b4e9-4f1d-8ca7-66199e33268d tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:17.377126 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-560ba228-b4e9-4f1d-8ca7-66199e33268d tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:17.386389 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-560ba228-b4e9-4f1d-8ca7-66199e33268d tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:17.388081 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-560ba228-b4e9-4f1d-8ca7-66199e33268d tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:17.389462 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-560ba228-b4e9-4f1d-8ca7-66199e33268d tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 200 len: 1741 microversion: 2.20 time: 0.247929 Jun 16 19:06:17.391223 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 418/851] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:06:17 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 1741 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:06:18.409877 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-ab832c9e-63fc-41ff-8ec3-a2341d38e6aa tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:18.410646 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-ab832c9e-63fc-41ff-8ec3-a2341d38e6aa tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:18.418177 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ab832c9e-63fc-41ff-8ec3-a2341d38e6aa tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:18.418698 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ab832c9e-63fc-41ff-8ec3-a2341d38e6aa tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:18.419583 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ab832c9e-63fc-41ff-8ec3-a2341d38e6aa tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:18.420087 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ab832c9e-63fc-41ff-8ec3-a2341d38e6aa tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:18.645486 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-ab832c9e-63fc-41ff-8ec3-a2341d38e6aa tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:18.655015 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-ab832c9e-63fc-41ff-8ec3-a2341d38e6aa tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:18.656552 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-ab832c9e-63fc-41ff-8ec3-a2341d38e6aa tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:18.657942 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-ab832c9e-63fc-41ff-8ec3-a2341d38e6aa tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 200 len: 1741 microversion: 2.20 time: 0.252596 Jun 16 19:06:18.670351 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 434/852] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:06:18 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 1741 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:06:19.676118 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-184913bd-ce3e-48b3-aafc-a754505bfa4d tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:19.676742 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-184913bd-ce3e-48b3-aafc-a754505bfa4d tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:19.682951 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-184913bd-ce3e-48b3-aafc-a754505bfa4d tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:19.683398 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-184913bd-ce3e-48b3-aafc-a754505bfa4d tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:19.684421 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-184913bd-ce3e-48b3-aafc-a754505bfa4d tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:19.684921 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-184913bd-ce3e-48b3-aafc-a754505bfa4d tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:19.822523 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-184913bd-ce3e-48b3-aafc-a754505bfa4d tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:19.831558 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-184913bd-ce3e-48b3-aafc-a754505bfa4d tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:19.833060 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-184913bd-ce3e-48b3-aafc-a754505bfa4d tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:19.834217 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-184913bd-ce3e-48b3-aafc-a754505bfa4d tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 200 len: 1741 microversion: 2.20 time: 0.162749 Jun 16 19:06:19.846154 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 419/853] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:06:19 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 1741 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:06:20.853285 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-bf7d0cbb-d2b0-4f9a-824d-07bb8d996334 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:20.853979 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-bf7d0cbb-d2b0-4f9a-824d-07bb8d996334 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:20.856467 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_api:SELECT=42 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:06:20.861730 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-bf7d0cbb-d2b0-4f9a-824d-07bb8d996334 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:20.862263 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-bf7d0cbb-d2b0-4f9a-824d-07bb8d996334 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:20.865619 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-bf7d0cbb-d2b0-4f9a-824d-07bb8d996334 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:20.865619 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-bf7d0cbb-d2b0-4f9a-824d-07bb8d996334 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:20.876477 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-d951aa06-6d3a-4479-ad98-ce3da7912387 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:20.876988 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-d951aa06-6d3a-4479-ad98-ce3da7912387 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 6c2833a5-6276-4288-8c3e-1e82a8a2cca5] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:20.881045 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_api:SELECT=40 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:06:20.885839 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d951aa06-6d3a-4479-ad98-ce3da7912387 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:20.886382 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d951aa06-6d3a-4479-ad98-ce3da7912387 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:20.887255 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d951aa06-6d3a-4479-ad98-ce3da7912387 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:20.887699 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d951aa06-6d3a-4479-ad98-ce3da7912387 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:20.915054 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-d951aa06-6d3a-4479-ad98-ce3da7912387 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/6c2833a5-6276-4288-8c3e-1e82a8a2cca5/ips" status: 200 len: 146 microversion: 2.1 time: 0.043763 Jun 16 19:06:20.915654 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 420/854] 10.222.0.70 () {58 vars in 1247 bytes} [Thu Jun 16 19:06:20 2022] GET /compute/v2.1/servers/6c2833a5-6276-4288-8c3e-1e82a8a2cca5/ips => generated 146 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:06:21.095235 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-bf7d0cbb-d2b0-4f9a-824d-07bb8d996334 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:21.103697 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-bf7d0cbb-d2b0-4f9a-824d-07bb8d996334 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:21.106243 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-bf7d0cbb-d2b0-4f9a-824d-07bb8d996334 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:21.107454 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-bf7d0cbb-d2b0-4f9a-824d-07bb8d996334 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 200 len: 1723 microversion: 2.20 time: 0.258150 Jun 16 19:06:21.108318 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 435/855] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:06:20 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 1723 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:06:22.128169 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-82d79923-aca3-4703-8bf8-fb2c9c838cda tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:22.128817 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-82d79923-aca3-4703-8bf8-fb2c9c838cda tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:22.135609 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-82d79923-aca3-4703-8bf8-fb2c9c838cda tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:22.136363 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-82d79923-aca3-4703-8bf8-fb2c9c838cda tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:22.136888 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-82d79923-aca3-4703-8bf8-fb2c9c838cda tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:22.137333 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-82d79923-aca3-4703-8bf8-fb2c9c838cda tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:22.273527 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-82d79923-aca3-4703-8bf8-fb2c9c838cda tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:22.284131 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-82d79923-aca3-4703-8bf8-fb2c9c838cda tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:22.286134 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-82d79923-aca3-4703-8bf8-fb2c9c838cda tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:22.287405 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-82d79923-aca3-4703-8bf8-fb2c9c838cda tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 200 len: 1723 microversion: 2.20 time: 0.163584 Jun 16 19:06:22.287954 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 421/856] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:06:22 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:06:22.292654 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-60ec5da0-59ce-4968-a64c-2fd5cc504f9a tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fd35271d-b241-4f2c-aed3-b7d743ede509"}} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:06:22.294656 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-60ec5da0-59ce-4968-a64c-2fd5cc504f9a tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 6c2833a5-6276-4288-8c3e-1e82a8a2cca5] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:22.302627 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-60ec5da0-59ce-4968-a64c-2fd5cc504f9a tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:22.303075 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-60ec5da0-59ce-4968-a64c-2fd5cc504f9a tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:22.303832 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-60ec5da0-59ce-4968-a64c-2fd5cc504f9a tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:22.304432 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-60ec5da0-59ce-4968-a64c-2fd5cc504f9a tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:22.574779 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-60ec5da0-59ce-4968-a64c-2fd5cc504f9a tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "POST /compute/v2.1/servers/6c2833a5-6276-4288-8c3e-1e82a8a2cca5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286119 Jun 16 19:06:22.575601 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 436/857] 10.222.0.70 () {60 vars in 1322 bytes} [Thu Jun 16 19:06:22 2022] POST /compute/v2.1/servers/6c2833a5-6276-4288-8c3e-1e82a8a2cca5/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:06:23.306013 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-74488b94-9711-4dcd-a7ea-806696bf5fc8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:23.306714 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-74488b94-9711-4dcd-a7ea-806696bf5fc8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:23.313954 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-74488b94-9711-4dcd-a7ea-806696bf5fc8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:23.314167 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-74488b94-9711-4dcd-a7ea-806696bf5fc8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:23.315103 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-74488b94-9711-4dcd-a7ea-806696bf5fc8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:23.315572 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-74488b94-9711-4dcd-a7ea-806696bf5fc8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:23.477993 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-74488b94-9711-4dcd-a7ea-806696bf5fc8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:23.486629 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-74488b94-9711-4dcd-a7ea-806696bf5fc8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:23.488153 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-74488b94-9711-4dcd-a7ea-806696bf5fc8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:23.489323 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-74488b94-9711-4dcd-a7ea-806696bf5fc8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 200 len: 1666 microversion: 2.20 time: 0.187417 Jun 16 19:06:23.490341 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 422/858] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:06:23 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 1666 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:06:23.508156 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-35bc4ea8-3330-48be-9a7d-6dd1370e0f1a tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "65431bd0-38cb-45cd-9498-72daa714bd9f"}} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:06:23.509505 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-35bc4ea8-3330-48be-9a7d-6dd1370e0f1a tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:23.516902 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-35bc4ea8-3330-48be-9a7d-6dd1370e0f1a tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:23.517436 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-35bc4ea8-3330-48be-9a7d-6dd1370e0f1a tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:23.518282 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-35bc4ea8-3330-48be-9a7d-6dd1370e0f1a tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:23.518762 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-35bc4ea8-3330-48be-9a7d-6dd1370e0f1a tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:23.822025 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-35bc4ea8-3330-48be-9a7d-6dd1370e0f1a tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "POST /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.318209 Jun 16 19:06:23.822650 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 437/859] 10.222.0.70 () {62 vars in 1363 bytes} [Thu Jun 16 19:06:23 2022] POST /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6/os-volume_attachments => generated 188 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 19:06:23.946509 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-2d7eab1c-cdbb-4e22-8348-9cee09c80863 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:23.947389 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-2d7eab1c-cdbb-4e22-8348-9cee09c80863 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:23.954911 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-2d7eab1c-cdbb-4e22-8348-9cee09c80863 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:23.955366 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-2d7eab1c-cdbb-4e22-8348-9cee09c80863 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:23.956353 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-2d7eab1c-cdbb-4e22-8348-9cee09c80863 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:23.956794 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-2d7eab1c-cdbb-4e22-8348-9cee09c80863 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:24.127002 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [req-9267191e-b465-4d89-81e1-924529468dd8 req-e9ddcc80-b058-4d32-b108-ca086ea0713a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac8de877-3a07-4017-99fb-45b37ef123b6", "name": "network-vif-unplugged", "status": "completed", "tag": "8bd9db24-3ac1-4beb-93fd-9cdfca791f22"}]} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:06:24.136805 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-9267191e-b465-4d89-81e1-924529468dd8 req-e9ddcc80-b058-4d32-b108-ca086ea0713a service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:24.137126 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-9267191e-b465-4d89-81e1-924529468dd8 req-e9ddcc80-b058-4d32-b108-ca086ea0713a service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:24.142878 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:06:24.150308 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.compute.server_external_events [req-9267191e-b465-4d89-81e1-924529468dd8 req-e9ddcc80-b058-4d32-b108-ca086ea0713a service nova] Unable to find a host for instance ac8de877-3a07-4017-99fb-45b37ef123b6. Dropping event network-vif-unplugged {{(pid=117852) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 16 19:06:24.151690 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [req-9267191e-b465-4d89-81e1-924529468dd8 req-e9ddcc80-b058-4d32-b108-ca086ea0713a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028834 Jun 16 19:06:24.152818 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 438/860] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:06:24 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 16 19:06:24.245861 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-2d7eab1c-cdbb-4e22-8348-9cee09c80863 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "DELETE /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6/os-volume_attachments/65431bd0-38cb-45cd-9498-72daa714bd9f" status: 202 len: 0 microversion: 2.20 time: 0.304044 Jun 16 19:06:24.246544 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 423/861] 10.222.0.70 () {60 vars in 1456 bytes} [Thu Jun 16 19:06:23 2022] DELETE /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6/os-volume_attachments/65431bd0-38cb-45cd-9498-72daa714bd9f => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:06:24.305513 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-843b1241-77d9-4e53-b85b-fe21245361e8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:06:24.306078 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-843b1241-77d9-4e53-b85b-fe21245361e8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:24.313470 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-843b1241-77d9-4e53-b85b-fe21245361e8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:24.314010 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-843b1241-77d9-4e53-b85b-fe21245361e8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:24.314828 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-843b1241-77d9-4e53-b85b-fe21245361e8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:24.315432 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-843b1241-77d9-4e53-b85b-fe21245361e8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:24.416222 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-843b1241-77d9-4e53-b85b-fe21245361e8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "POST /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6/action" status: 202 len: 0 microversion: 2.20 time: 0.114620 Jun 16 19:06:24.420152 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 439/862] 10.222.0.70 () {62 vars in 1318 bytes} [Thu Jun 16 19:06:24 2022] POST /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:06:24.426408 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-73fe0842-1d3d-4ed2-95fd-842aa1f73276 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:24.427050 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-73fe0842-1d3d-4ed2-95fd-842aa1f73276 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:24.435576 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-73fe0842-1d3d-4ed2-95fd-842aa1f73276 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:24.436201 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-73fe0842-1d3d-4ed2-95fd-842aa1f73276 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:24.437556 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-73fe0842-1d3d-4ed2-95fd-842aa1f73276 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:24.438062 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-73fe0842-1d3d-4ed2-95fd-842aa1f73276 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:24.586705 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-73fe0842-1d3d-4ed2-95fd-842aa1f73276 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:24.597527 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-73fe0842-1d3d-4ed2-95fd-842aa1f73276 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:24.599759 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-73fe0842-1d3d-4ed2-95fd-842aa1f73276 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:24.601212 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-73fe0842-1d3d-4ed2-95fd-842aa1f73276 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 200 len: 1674 microversion: 2.20 time: 0.179798 Jun 16 19:06:24.601869 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 424/863] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:06:24 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 1674 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:06:25.621741 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-f28078ff-e2d0-4708-8e7d-22a81d622cf6 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:25.623185 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-f28078ff-e2d0-4708-8e7d-22a81d622cf6 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:25.630473 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f28078ff-e2d0-4708-8e7d-22a81d622cf6 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:25.631101 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f28078ff-e2d0-4708-8e7d-22a81d622cf6 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:25.632109 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f28078ff-e2d0-4708-8e7d-22a81d622cf6 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:25.632645 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f28078ff-e2d0-4708-8e7d-22a81d622cf6 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:25.786677 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-f28078ff-e2d0-4708-8e7d-22a81d622cf6 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:25.795835 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-f28078ff-e2d0-4708-8e7d-22a81d622cf6 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:25.797697 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-f28078ff-e2d0-4708-8e7d-22a81d622cf6 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:25.799031 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-f28078ff-e2d0-4708-8e7d-22a81d622cf6 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 200 len: 1674 microversion: 2.20 time: 0.182034 Jun 16 19:06:25.799647 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 440/864] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:06:25 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 1674 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:06:26.818436 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-208be900-fed8-4138-b05c-62416f1e8cc0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:26.819331 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-208be900-fed8-4138-b05c-62416f1e8cc0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:26.826385 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-208be900-fed8-4138-b05c-62416f1e8cc0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:26.826903 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-208be900-fed8-4138-b05c-62416f1e8cc0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:26.828316 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-208be900-fed8-4138-b05c-62416f1e8cc0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:26.828874 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-208be900-fed8-4138-b05c-62416f1e8cc0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:27.097082 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-208be900-fed8-4138-b05c-62416f1e8cc0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:27.105515 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-208be900-fed8-4138-b05c-62416f1e8cc0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:27.107412 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-208be900-fed8-4138-b05c-62416f1e8cc0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:27.109672 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-208be900-fed8-4138-b05c-62416f1e8cc0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 200 len: 1732 microversion: 2.20 time: 0.294685 Jun 16 19:06:27.110541 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 425/865] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:06:26 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 1732 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:06:28.129173 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-22782820-fce5-4d42-8b75-ac39480ff18f tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:28.129888 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-22782820-fce5-4d42-8b75-ac39480ff18f tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:28.138427 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-22782820-fce5-4d42-8b75-ac39480ff18f tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:28.143187 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-22782820-fce5-4d42-8b75-ac39480ff18f tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:28.144105 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-22782820-fce5-4d42-8b75-ac39480ff18f tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:28.144752 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-22782820-fce5-4d42-8b75-ac39480ff18f tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:28.310969 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-22782820-fce5-4d42-8b75-ac39480ff18f tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:28.321640 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-22782820-fce5-4d42-8b75-ac39480ff18f tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:28.323610 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-22782820-fce5-4d42-8b75-ac39480ff18f tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:28.324850 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-22782820-fce5-4d42-8b75-ac39480ff18f tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 200 len: 1732 microversion: 2.20 time: 0.199702 Jun 16 19:06:28.325472 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 441/866] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:06:28 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 1732 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:06:29.349896 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-d70a2444-2086-404d-b8dc-febef9b53e70 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:29.354153 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-d70a2444-2086-404d-b8dc-febef9b53e70 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:29.371640 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d70a2444-2086-404d-b8dc-febef9b53e70 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:29.372166 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d70a2444-2086-404d-b8dc-febef9b53e70 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:29.373016 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d70a2444-2086-404d-b8dc-febef9b53e70 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:29.373463 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d70a2444-2086-404d-b8dc-febef9b53e70 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:29.584187 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-d70a2444-2086-404d-b8dc-febef9b53e70 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:29.592564 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-d70a2444-2086-404d-b8dc-febef9b53e70 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:29.596265 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-d70a2444-2086-404d-b8dc-febef9b53e70 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:29.597669 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-d70a2444-2086-404d-b8dc-febef9b53e70 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 200 len: 1732 microversion: 2.20 time: 0.256144 Jun 16 19:06:29.598998 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 426/867] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:06:29 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 1732 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:06:30.617755 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-60551832-912c-4eef-9ada-6a61d098f0e8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:30.618363 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-60551832-912c-4eef-9ada-6a61d098f0e8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:30.626056 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-60551832-912c-4eef-9ada-6a61d098f0e8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:30.626789 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-60551832-912c-4eef-9ada-6a61d098f0e8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:30.629253 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-60551832-912c-4eef-9ada-6a61d098f0e8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:30.629810 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-60551832-912c-4eef-9ada-6a61d098f0e8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:30.813413 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-60551832-912c-4eef-9ada-6a61d098f0e8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:30.826400 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-60551832-912c-4eef-9ada-6a61d098f0e8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:30.828899 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-60551832-912c-4eef-9ada-6a61d098f0e8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:30.830384 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-60551832-912c-4eef-9ada-6a61d098f0e8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 200 len: 1732 microversion: 2.20 time: 0.216560 Jun 16 19:06:30.831708 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 442/868] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:06:30 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 1732 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:06:31.849618 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-248158f3-e647-4c25-9d37-23d388781fce tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:31.850478 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-248158f3-e647-4c25-9d37-23d388781fce tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:31.857363 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-248158f3-e647-4c25-9d37-23d388781fce tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:31.857814 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-248158f3-e647-4c25-9d37-23d388781fce tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:31.858602 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-248158f3-e647-4c25-9d37-23d388781fce tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:31.859086 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-248158f3-e647-4c25-9d37-23d388781fce tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:32.019403 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-248158f3-e647-4c25-9d37-23d388781fce tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:32.049479 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-248158f3-e647-4c25-9d37-23d388781fce tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:32.058207 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-248158f3-e647-4c25-9d37-23d388781fce tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:32.060033 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-248158f3-e647-4c25-9d37-23d388781fce tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 200 len: 1732 microversion: 2.20 time: 0.214283 Jun 16 19:06:32.071973 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 427/869] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:06:31 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 1732 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:06:33.079975 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-2a7a66be-a9b8-4d38-aaa7-4a9696a0ee94 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:33.080877 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-2a7a66be-a9b8-4d38-aaa7-4a9696a0ee94 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:33.087766 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-2a7a66be-a9b8-4d38-aaa7-4a9696a0ee94 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:33.088220 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-2a7a66be-a9b8-4d38-aaa7-4a9696a0ee94 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:33.088998 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-2a7a66be-a9b8-4d38-aaa7-4a9696a0ee94 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:33.089475 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-2a7a66be-a9b8-4d38-aaa7-4a9696a0ee94 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:33.242465 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-2a7a66be-a9b8-4d38-aaa7-4a9696a0ee94 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:33.251376 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-2a7a66be-a9b8-4d38-aaa7-4a9696a0ee94 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:33.252877 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-2a7a66be-a9b8-4d38-aaa7-4a9696a0ee94 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:33.254035 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-2a7a66be-a9b8-4d38-aaa7-4a9696a0ee94 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 200 len: 1732 microversion: 2.20 time: 0.178281 Jun 16 19:06:33.254593 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 443/870] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:06:33 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 1732 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:06:34.272634 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-68edcdaf-1f14-4891-80ac-fe2d3769d8bc tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:34.273266 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-68edcdaf-1f14-4891-80ac-fe2d3769d8bc tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:34.281293 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-68edcdaf-1f14-4891-80ac-fe2d3769d8bc tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:34.281844 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-68edcdaf-1f14-4891-80ac-fe2d3769d8bc tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:34.282640 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-68edcdaf-1f14-4891-80ac-fe2d3769d8bc tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:34.283144 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-68edcdaf-1f14-4891-80ac-fe2d3769d8bc tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:34.432106 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-68edcdaf-1f14-4891-80ac-fe2d3769d8bc tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:34.434628 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:06:34.443406 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-68edcdaf-1f14-4891-80ac-fe2d3769d8bc tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:34.444912 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-68edcdaf-1f14-4891-80ac-fe2d3769d8bc tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:34.446089 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-68edcdaf-1f14-4891-80ac-fe2d3769d8bc tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 200 len: 1732 microversion: 2.20 time: 0.177434 Jun 16 19:06:34.446677 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 428/871] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:06:34 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 1732 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:06:35.465846 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-0bb86a6c-39bd-4e23-90ec-ce9460599f10 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:35.466741 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-0bb86a6c-39bd-4e23-90ec-ce9460599f10 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:35.474343 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-0bb86a6c-39bd-4e23-90ec-ce9460599f10 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:35.474753 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-0bb86a6c-39bd-4e23-90ec-ce9460599f10 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:35.475525 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-0bb86a6c-39bd-4e23-90ec-ce9460599f10 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:35.476293 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-0bb86a6c-39bd-4e23-90ec-ce9460599f10 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:35.619001 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-0bb86a6c-39bd-4e23-90ec-ce9460599f10 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:35.627324 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-0bb86a6c-39bd-4e23-90ec-ce9460599f10 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:35.628825 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-0bb86a6c-39bd-4e23-90ec-ce9460599f10 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:35.630112 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-0bb86a6c-39bd-4e23-90ec-ce9460599f10 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 200 len: 1732 microversion: 2.20 time: 0.168620 Jun 16 19:06:35.630752 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 444/872] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:06:35 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 1732 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:06:36.651765 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-4b2f6a47-d8b5-4efe-970b-761757ba614e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:36.652393 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-4b2f6a47-d8b5-4efe-970b-761757ba614e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:36.659812 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-4b2f6a47-d8b5-4efe-970b-761757ba614e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:36.660293 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-4b2f6a47-d8b5-4efe-970b-761757ba614e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:36.661120 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-4b2f6a47-d8b5-4efe-970b-761757ba614e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:36.661586 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-4b2f6a47-d8b5-4efe-970b-761757ba614e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:36.801060 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-4b2f6a47-d8b5-4efe-970b-761757ba614e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:36.810178 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-4b2f6a47-d8b5-4efe-970b-761757ba614e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:36.812552 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-4b2f6a47-d8b5-4efe-970b-761757ba614e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:36.814270 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-4b2f6a47-d8b5-4efe-970b-761757ba614e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 200 len: 1732 microversion: 2.20 time: 0.169390 Jun 16 19:06:36.815075 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 429/873] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:06:36 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 1732 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:06:37.833279 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-f83e075b-28d2-4852-9449-0f5a8e4773fd tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:37.833907 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-f83e075b-28d2-4852-9449-0f5a8e4773fd tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:37.840426 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f83e075b-28d2-4852-9449-0f5a8e4773fd tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:37.840874 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f83e075b-28d2-4852-9449-0f5a8e4773fd tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:37.841630 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f83e075b-28d2-4852-9449-0f5a8e4773fd tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:37.842064 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f83e075b-28d2-4852-9449-0f5a8e4773fd tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:37.973315 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-f83e075b-28d2-4852-9449-0f5a8e4773fd tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:37.981260 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-f83e075b-28d2-4852-9449-0f5a8e4773fd tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:37.982788 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-f83e075b-28d2-4852-9449-0f5a8e4773fd tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:37.984584 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-f83e075b-28d2-4852-9449-0f5a8e4773fd tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 200 len: 1732 microversion: 2.20 time: 0.155406 Jun 16 19:06:37.985128 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 445/874] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:06:37 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:06:39.002973 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-d4b956bc-08fd-4a26-ba79-96f92d8cc611 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:39.004248 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-d4b956bc-08fd-4a26-ba79-96f92d8cc611 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:39.011268 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d4b956bc-08fd-4a26-ba79-96f92d8cc611 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:39.011718 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d4b956bc-08fd-4a26-ba79-96f92d8cc611 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:39.012488 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d4b956bc-08fd-4a26-ba79-96f92d8cc611 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:39.012930 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d4b956bc-08fd-4a26-ba79-96f92d8cc611 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:39.166291 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-d4b956bc-08fd-4a26-ba79-96f92d8cc611 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:39.185750 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-d4b956bc-08fd-4a26-ba79-96f92d8cc611 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:39.189010 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-d4b956bc-08fd-4a26-ba79-96f92d8cc611 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:39.190204 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-d4b956bc-08fd-4a26-ba79-96f92d8cc611 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 200 len: 1732 microversion: 2.20 time: 0.191843 Jun 16 19:06:39.190781 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 430/875] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:06:38 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 1732 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:06:39.754177 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-a0acbfaf-c3ff-4a21-a5d8-004907672e94 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:39.755195 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-a0acbfaf-c3ff-4a21-a5d8-004907672e94 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 6c2833a5-6276-4288-8c3e-1e82a8a2cca5] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:39.761692 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-a0acbfaf-c3ff-4a21-a5d8-004907672e94 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:39.762136 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-a0acbfaf-c3ff-4a21-a5d8-004907672e94 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:39.762924 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-a0acbfaf-c3ff-4a21-a5d8-004907672e94 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:39.763364 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-a0acbfaf-c3ff-4a21-a5d8-004907672e94 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:39.792035 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-a0acbfaf-c3ff-4a21-a5d8-004907672e94 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/6c2833a5-6276-4288-8c3e-1e82a8a2cca5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042702 Jun 16 19:06:39.792575 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 446/876] 10.222.0.70 () {58 vars in 1301 bytes} [Thu Jun 16 19:06:39 2022] GET /compute/v2.1/servers/6c2833a5-6276-4288-8c3e-1e82a8a2cca5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:06:39.803299 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-70bd7a0d-9436-407e-9aa6-5bc6a3a7aeca tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:39.803802 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-70bd7a0d-9436-407e-9aa6-5bc6a3a7aeca tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 6c2833a5-6276-4288-8c3e-1e82a8a2cca5] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:39.810055 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-70bd7a0d-9436-407e-9aa6-5bc6a3a7aeca tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:39.810513 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-70bd7a0d-9436-407e-9aa6-5bc6a3a7aeca tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:39.811967 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-70bd7a0d-9436-407e-9aa6-5bc6a3a7aeca tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:39.812443 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-70bd7a0d-9436-407e-9aa6-5bc6a3a7aeca tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:39.841921 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-70bd7a0d-9436-407e-9aa6-5bc6a3a7aeca tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/6c2833a5-6276-4288-8c3e-1e82a8a2cca5/os-volume_attachments/fd35271d-b241-4f2c-aed3-b7d743ede509" status: 200 len: 194 microversion: 2.1 time: 0.042577 Jun 16 19:06:39.842626 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 431/877] 10.222.0.70 () {58 vars in 1412 bytes} [Thu Jun 16 19:06:39 2022] GET /compute/v2.1/servers/6c2833a5-6276-4288-8c3e-1e82a8a2cca5/os-volume_attachments/fd35271d-b241-4f2c-aed3-b7d743ede509 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:06:40.208648 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-f67e6edc-abbd-41ce-9d9d-aa3a77b8552b tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:40.209263 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-f67e6edc-abbd-41ce-9d9d-aa3a77b8552b tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:40.215608 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f67e6edc-abbd-41ce-9d9d-aa3a77b8552b tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:40.216064 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f67e6edc-abbd-41ce-9d9d-aa3a77b8552b tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:40.216843 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f67e6edc-abbd-41ce-9d9d-aa3a77b8552b tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:40.217847 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f67e6edc-abbd-41ce-9d9d-aa3a77b8552b tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:40.354374 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-f67e6edc-abbd-41ce-9d9d-aa3a77b8552b tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:40.363582 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-f67e6edc-abbd-41ce-9d9d-aa3a77b8552b tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:40.365265 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-f67e6edc-abbd-41ce-9d9d-aa3a77b8552b tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:40.366499 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-f67e6edc-abbd-41ce-9d9d-aa3a77b8552b tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 200 len: 1732 microversion: 2.20 time: 0.162198 Jun 16 19:06:40.367072 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 447/878] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:06:40 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:06:41.161937 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-845f5fbe-a845-4a64-a22e-86264d83d8e8 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "947d810e-465d-41b8-bee7-3ac2db31fb6e"}} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:06:41.163096 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-845f5fbe-a845-4a64-a22e-86264d83d8e8 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 6c2833a5-6276-4288-8c3e-1e82a8a2cca5] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:41.169491 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-845f5fbe-a845-4a64-a22e-86264d83d8e8 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:41.169940 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-845f5fbe-a845-4a64-a22e-86264d83d8e8 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:41.170847 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-845f5fbe-a845-4a64-a22e-86264d83d8e8 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:41.171408 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-845f5fbe-a845-4a64-a22e-86264d83d8e8 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:41.390491 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-08262b46-22de-4014-93e6-795065ade431 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:41.391232 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-08262b46-22de-4014-93e6-795065ade431 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:41.397243 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-08262b46-22de-4014-93e6-795065ade431 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:41.397697 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-08262b46-22de-4014-93e6-795065ade431 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:41.398467 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-08262b46-22de-4014-93e6-795065ade431 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:41.399532 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-08262b46-22de-4014-93e6-795065ade431 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:41.409313 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-845f5fbe-a845-4a64-a22e-86264d83d8e8 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "POST /compute/v2.1/servers/6c2833a5-6276-4288-8c3e-1e82a8a2cca5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.251158 Jun 16 19:06:41.409920 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 432/879] 10.222.0.70 () {60 vars in 1322 bytes} [Thu Jun 16 19:06:41 2022] POST /compute/v2.1/servers/6c2833a5-6276-4288-8c3e-1e82a8a2cca5/os-volume_attachments => generated 194 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:06:41.544992 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-08262b46-22de-4014-93e6-795065ade431 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:41.553357 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-08262b46-22de-4014-93e6-795065ade431 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:41.554908 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-08262b46-22de-4014-93e6-795065ade431 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:41.556107 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-08262b46-22de-4014-93e6-795065ade431 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 200 len: 1732 microversion: 2.20 time: 0.170502 Jun 16 19:06:41.556653 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 448/880] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:06:41 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 1732 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:06:42.221532 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [req-c109a096-4d10-4307-bfce-af04f70105da req-50bbcfc8-e437-460d-badf-45f177f377fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac8de877-3a07-4017-99fb-45b37ef123b6", "name": "network-vif-plugged", "status": "completed", "tag": "8bd9db24-3ac1-4beb-93fd-9cdfca791f22"}]} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:06:42.232050 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-c109a096-4d10-4307-bfce-af04f70105da req-50bbcfc8-e437-460d-badf-45f177f377fa service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:42.232501 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-c109a096-4d10-4307-bfce-af04f70105da req-50bbcfc8-e437-460d-badf-45f177f377fa service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:42.250742 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.compute.server_external_events [req-c109a096-4d10-4307-bfce-af04f70105da req-50bbcfc8-e437-460d-badf-45f177f377fa service nova] Creating event network-vif-plugged:8bd9db24-3ac1-4beb-93fd-9cdfca791f22 for instance ac8de877-3a07-4017-99fb-45b37ef123b6 on hv-cinder-84617 Jun 16 19:06:42.267447 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [req-c109a096-4d10-4307-bfce-af04f70105da req-50bbcfc8-e437-460d-badf-45f177f377fa service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041642 Jun 16 19:06:42.267447 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 433/881] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:06:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:06:42.575308 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-d7a0ef0b-e4e6-42ca-ba60-39da4ec358d2 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:42.575959 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-d7a0ef0b-e4e6-42ca-ba60-39da4ec358d2 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:42.583344 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d7a0ef0b-e4e6-42ca-ba60-39da4ec358d2 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:42.583788 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d7a0ef0b-e4e6-42ca-ba60-39da4ec358d2 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:42.584558 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d7a0ef0b-e4e6-42ca-ba60-39da4ec358d2 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:42.584989 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d7a0ef0b-e4e6-42ca-ba60-39da4ec358d2 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:42.720801 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-d7a0ef0b-e4e6-42ca-ba60-39da4ec358d2 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:42.728717 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-d7a0ef0b-e4e6-42ca-ba60-39da4ec358d2 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:42.730211 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-d7a0ef0b-e4e6-42ca-ba60-39da4ec358d2 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:42.731384 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-d7a0ef0b-e4e6-42ca-ba60-39da4ec358d2 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 200 len: 1732 microversion: 2.20 time: 0.160179 Jun 16 19:06:42.731924 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 449/882] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:06:42 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:06:43.751128 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-fb59abbb-dd96-4aa0-9c64-37ef10b727dc tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:43.751842 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-fb59abbb-dd96-4aa0-9c64-37ef10b727dc tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:43.758767 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-fb59abbb-dd96-4aa0-9c64-37ef10b727dc tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:43.759440 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-fb59abbb-dd96-4aa0-9c64-37ef10b727dc tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:43.760409 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-fb59abbb-dd96-4aa0-9c64-37ef10b727dc tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:43.761016 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-fb59abbb-dd96-4aa0-9c64-37ef10b727dc tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:43.912954 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-fb59abbb-dd96-4aa0-9c64-37ef10b727dc tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:43.925254 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-fb59abbb-dd96-4aa0-9c64-37ef10b727dc tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:43.928056 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-fb59abbb-dd96-4aa0-9c64-37ef10b727dc tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:43.929600 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-fb59abbb-dd96-4aa0-9c64-37ef10b727dc tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 200 len: 1732 microversion: 2.20 time: 0.183459 Jun 16 19:06:43.930666 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 434/883] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:06:43 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 1732 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:06:44.380954 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-872c09fd-0d79-4fe0-9101-ef5638b8656a tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:44.381464 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-872c09fd-0d79-4fe0-9101-ef5638b8656a tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] [instance: c4277200-c999-4c53-85de-b2a8b120cd6d] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:44.383807 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [req-a53a3e21-f1d1-4d96-96fd-6bfd8e12dbb9 req-c9cd4523-d051-408d-a1c0-ab12477049b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4277200-c999-4c53-85de-b2a8b120cd6d", "tag": "52aa00b3-538a-446a-8118-2c3fa72e640d"}]} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:06:44.388055 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-872c09fd-0d79-4fe0-9101-ef5638b8656a tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:44.388796 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-872c09fd-0d79-4fe0-9101-ef5638b8656a tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:44.390305 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-872c09fd-0d79-4fe0-9101-ef5638b8656a tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:44.391109 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-872c09fd-0d79-4fe0-9101-ef5638b8656a tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:44.401456 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-a53a3e21-f1d1-4d96-96fd-6bfd8e12dbb9 req-c9cd4523-d051-408d-a1c0-ab12477049b0 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:44.401932 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-a53a3e21-f1d1-4d96-96fd-6bfd8e12dbb9 req-c9cd4523-d051-408d-a1c0-ab12477049b0 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:44.414715 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.compute.server_external_events [req-a53a3e21-f1d1-4d96-96fd-6bfd8e12dbb9 req-c9cd4523-d051-408d-a1c0-ab12477049b0 service nova] Creating event network-changed:52aa00b3-538a-446a-8118-2c3fa72e640d for instance c4277200-c999-4c53-85de-b2a8b120cd6d on hv-cinder-84617 Jun 16 19:06:44.418098 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-872c09fd-0d79-4fe0-9101-ef5638b8656a tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] [instance: c4277200-c999-4c53-85de-b2a8b120cd6d] Going to try to terminate instance {{(pid=117852) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:06:44.419677 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [req-a53a3e21-f1d1-4d96-96fd-6bfd8e12dbb9 req-c9cd4523-d051-408d-a1c0-ab12477049b0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039474 Jun 16 19:06:44.421256 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 435/884] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:06:44.504099 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-872c09fd-0d79-4fe0-9101-ef5638b8656a tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] 10.222.0.70 "DELETE /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d" status: 204 len: 0 microversion: 2.1 time: 0.126645 Jun 16 19:06:44.504800 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 450/885] 10.222.0.70 () {58 vars in 1238 bytes} [Thu Jun 16 19:06:44 2022] DELETE /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:06:44.515964 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-425e2f66-9828-456c-9ec6-d767550cb9ee tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:44.517430 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-425e2f66-9828-456c-9ec6-d767550cb9ee tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] [instance: c4277200-c999-4c53-85de-b2a8b120cd6d] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:44.526033 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-425e2f66-9828-456c-9ec6-d767550cb9ee tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:44.526518 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-425e2f66-9828-456c-9ec6-d767550cb9ee tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:44.528499 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-425e2f66-9828-456c-9ec6-d767550cb9ee tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:44.529153 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-425e2f66-9828-456c-9ec6-d767550cb9ee tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:44.895297 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-425e2f66-9828-456c-9ec6-d767550cb9ee tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27db09b804fa426a83f103cf5dd116a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629634dc3dc54893b68cb9c9dc08505d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:44.903503 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-425e2f66-9828-456c-9ec6-d767550cb9ee tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] 10.222.0.70 "GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d" status: 200 len: 1567 microversion: 2.1 time: 0.394271 Jun 16 19:06:44.904151 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 436/886] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:06:44 2022] GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d => generated 1567 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:06:44.949899 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-395e07d8-8a54-4223-bd84-fae6119c22d3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:44.950620 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-395e07d8-8a54-4223-bd84-fae6119c22d3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:44.957718 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-395e07d8-8a54-4223-bd84-fae6119c22d3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:44.958175 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-395e07d8-8a54-4223-bd84-fae6119c22d3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:44.959076 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-395e07d8-8a54-4223-bd84-fae6119c22d3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:44.959517 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-395e07d8-8a54-4223-bd84-fae6119c22d3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:45.093874 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-395e07d8-8a54-4223-bd84-fae6119c22d3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:45.102000 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-395e07d8-8a54-4223-bd84-fae6119c22d3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:45.103728 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-395e07d8-8a54-4223-bd84-fae6119c22d3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:45.105010 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-395e07d8-8a54-4223-bd84-fae6119c22d3 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 200 len: 1719 microversion: 2.20 time: 0.159400 Jun 16 19:06:45.105917 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 451/887] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:06:44 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 1719 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:06:45.922348 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-e6878fd6-4c5c-4682-924f-a8e29dc0fa7e tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:45.923027 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-e6878fd6-4c5c-4682-924f-a8e29dc0fa7e tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] [instance: c4277200-c999-4c53-85de-b2a8b120cd6d] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:45.930563 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-e6878fd6-4c5c-4682-924f-a8e29dc0fa7e tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:45.931049 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-e6878fd6-4c5c-4682-924f-a8e29dc0fa7e tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:45.931823 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-e6878fd6-4c5c-4682-924f-a8e29dc0fa7e tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:45.932261 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-e6878fd6-4c5c-4682-924f-a8e29dc0fa7e tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:46.112030 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-e6878fd6-4c5c-4682-924f-a8e29dc0fa7e tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27db09b804fa426a83f103cf5dd116a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629634dc3dc54893b68cb9c9dc08505d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:46.119621 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-e6878fd6-4c5c-4682-924f-a8e29dc0fa7e tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] 10.222.0.70 "GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d" status: 200 len: 1567 microversion: 2.1 time: 0.201917 Jun 16 19:06:46.120182 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 437/888] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:06:45 2022] GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d => generated 1567 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:06:46.857310 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [req-4b6d331a-d2fc-472b-9dbd-7ce65978a678 req-0af18926-443b-4054-b4de-213f87c41d4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4277200-c999-4c53-85de-b2a8b120cd6d", "name": "network-vif-deleted", "tag": "52aa00b3-538a-446a-8118-2c3fa72e640d"}]} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:06:46.867990 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-4b6d331a-d2fc-472b-9dbd-7ce65978a678 req-0af18926-443b-4054-b4de-213f87c41d4b service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:46.868436 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-4b6d331a-d2fc-472b-9dbd-7ce65978a678 req-0af18926-443b-4054-b4de-213f87c41d4b service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:46.880149 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.compute.server_external_events [req-4b6d331a-d2fc-472b-9dbd-7ce65978a678 req-0af18926-443b-4054-b4de-213f87c41d4b service nova] Creating event network-vif-deleted:52aa00b3-538a-446a-8118-2c3fa72e640d for instance c4277200-c999-4c53-85de-b2a8b120cd6d on hv-cinder-84617 Jun 16 19:06:46.885622 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [req-4b6d331a-d2fc-472b-9dbd-7ce65978a678 req-0af18926-443b-4054-b4de-213f87c41d4b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031760 Jun 16 19:06:46.886220 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 452/889] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:06:47.137032 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-7b799f08-349f-401d-b909-dcb54552d888 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:47.137771 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-7b799f08-349f-401d-b909-dcb54552d888 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] [instance: c4277200-c999-4c53-85de-b2a8b120cd6d] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:47.145694 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-7b799f08-349f-401d-b909-dcb54552d888 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:47.146145 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-7b799f08-349f-401d-b909-dcb54552d888 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:47.146945 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-7b799f08-349f-401d-b909-dcb54552d888 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:47.147381 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-7b799f08-349f-401d-b909-dcb54552d888 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:47.211825 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-7b799f08-349f-401d-b909-dcb54552d888 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27db09b804fa426a83f103cf5dd116a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629634dc3dc54893b68cb9c9dc08505d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:47.220649 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-7b799f08-349f-401d-b909-dcb54552d888 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] 10.222.0.70 "GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d" status: 200 len: 1219 microversion: 2.1 time: 0.087352 Jun 16 19:06:47.221223 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 438/890] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:06:47 2022] GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:06:48.239519 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-c93610c7-7bee-43b9-a6ad-dbd4d7829a35 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:48.240294 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-c93610c7-7bee-43b9-a6ad-dbd4d7829a35 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] [instance: c4277200-c999-4c53-85de-b2a8b120cd6d] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:48.246398 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-c93610c7-7bee-43b9-a6ad-dbd4d7829a35 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:48.246872 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-c93610c7-7bee-43b9-a6ad-dbd4d7829a35 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:48.247620 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-c93610c7-7bee-43b9-a6ad-dbd4d7829a35 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:48.248054 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-c93610c7-7bee-43b9-a6ad-dbd4d7829a35 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:48.266547 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:06:48.282997 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-c93610c7-7bee-43b9-a6ad-dbd4d7829a35 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:48.283441 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-c93610c7-7bee-43b9-a6ad-dbd4d7829a35 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:48.283883 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.objects.instance [None req-c93610c7-7bee-43b9-a6ad-dbd4d7829a35 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lazy-loading 'fault' on Instance uuid c4277200-c999-4c53-85de-b2a8b120cd6d {{(pid=117852) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:06:48.328846 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-c93610c7-7bee-43b9-a6ad-dbd4d7829a35 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27db09b804fa426a83f103cf5dd116a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '629634dc3dc54893b68cb9c9dc08505d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:48.336389 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-c93610c7-7bee-43b9-a6ad-dbd4d7829a35 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] 10.222.0.70 "GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d" status: 200 len: 1224 microversion: 2.1 time: 0.101593 Jun 16 19:06:48.336940 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 453/891] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:06:48 2022] GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d => generated 1224 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:06:48.938138 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-c9b70088-22d1-4ac0-b70d-126f07f81902 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:48.939447 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-c9b70088-22d1-4ac0-b70d-126f07f81902 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 6c2833a5-6276-4288-8c3e-1e82a8a2cca5] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:48.948439 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-c9b70088-22d1-4ac0-b70d-126f07f81902 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:48.948898 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-c9b70088-22d1-4ac0-b70d-126f07f81902 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:48.950041 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-c9b70088-22d1-4ac0-b70d-126f07f81902 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:48.950146 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-c9b70088-22d1-4ac0-b70d-126f07f81902 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:48.981272 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-c9b70088-22d1-4ac0-b70d-126f07f81902 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/6c2833a5-6276-4288-8c3e-1e82a8a2cca5/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048120 Jun 16 19:06:48.981834 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 439/892] 10.222.0.70 () {58 vars in 1301 bytes} [Thu Jun 16 19:06:48 2022] GET /compute/v2.1/servers/6c2833a5-6276-4288-8c3e-1e82a8a2cca5/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:06:49.128272 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-f6318abe-c496-426e-9045-dc66a31c53e0 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:49.128684 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-f6318abe-c496-426e-9045-dc66a31c53e0 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 6c2833a5-6276-4288-8c3e-1e82a8a2cca5] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:49.134686 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f6318abe-c496-426e-9045-dc66a31c53e0 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:49.135134 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f6318abe-c496-426e-9045-dc66a31c53e0 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:49.135883 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f6318abe-c496-426e-9045-dc66a31c53e0 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:49.136317 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f6318abe-c496-426e-9045-dc66a31c53e0 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:49.164542 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-f6318abe-c496-426e-9045-dc66a31c53e0 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/6c2833a5-6276-4288-8c3e-1e82a8a2cca5/os-volume_attachments/fd35271d-b241-4f2c-aed3-b7d743ede509" status: 200 len: 194 microversion: 2.1 time: 0.041073 Jun 16 19:06:49.165108 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 454/893] 10.222.0.70 () {58 vars in 1412 bytes} [Thu Jun 16 19:06:49 2022] GET /compute/v2.1/servers/6c2833a5-6276-4288-8c3e-1e82a8a2cca5/os-volume_attachments/fd35271d-b241-4f2c-aed3-b7d743ede509 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:06:49.174649 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-d7622f7c-c7f7-462b-9ace-e6bc4b24b008 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:49.175744 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-d7622f7c-c7f7-462b-9ace-e6bc4b24b008 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 6c2833a5-6276-4288-8c3e-1e82a8a2cca5] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:49.182317 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d7622f7c-c7f7-462b-9ace-e6bc4b24b008 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:49.182804 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d7622f7c-c7f7-462b-9ace-e6bc4b24b008 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:49.183564 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d7622f7c-c7f7-462b-9ace-e6bc4b24b008 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:49.183997 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d7622f7c-c7f7-462b-9ace-e6bc4b24b008 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:49.265768 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.objects.instance [None req-d7622f7c-c7f7-462b-9ace-e6bc4b24b008 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lazy-loading 'services' on Instance uuid 6c2833a5-6276-4288-8c3e-1e82a8a2cca5 {{(pid=117850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:06:49.338289 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-d7622f7c-c7f7-462b-9ace-e6bc4b24b008 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "DELETE /compute/v2.1/servers/6c2833a5-6276-4288-8c3e-1e82a8a2cca5/os-volume_attachments/fd35271d-b241-4f2c-aed3-b7d743ede509" status: 202 len: 0 microversion: 2.1 time: 0.167404 Jun 16 19:06:49.338993 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 440/894] 10.222.0.70 () {58 vars in 1415 bytes} [Thu Jun 16 19:06:49 2022] DELETE /compute/v2.1/servers/6c2833a5-6276-4288-8c3e-1e82a8a2cca5/os-volume_attachments/fd35271d-b241-4f2c-aed3-b7d743ede509 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:06:49.355891 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-97f1874d-3d2c-4739-be78-c9cafa9ab276 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:49.356497 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-97f1874d-3d2c-4739-be78-c9cafa9ab276 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] [instance: c4277200-c999-4c53-85de-b2a8b120cd6d] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:49.363906 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-97f1874d-3d2c-4739-be78-c9cafa9ab276 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:49.364637 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-97f1874d-3d2c-4739-be78-c9cafa9ab276 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:49.365606 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-97f1874d-3d2c-4739-be78-c9cafa9ab276 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:49.366189 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-97f1874d-3d2c-4739-be78-c9cafa9ab276 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:49.381407 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.wsgi [None req-97f1874d-3d2c-4739-be78-c9cafa9ab276 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] HTTP exception thrown: Instance c4277200-c999-4c53-85de-b2a8b120cd6d could not be found. Jun 16 19:06:49.383036 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-97f1874d-3d2c-4739-be78-c9cafa9ab276 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Request method failure captured: Jun 16 19:06:49.383036 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: request: GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d HTTP/1.1 Jun 16 19:06:49.383036 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Accept: application/json Jun 16 19:06:49.383036 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Accept-Encoding: identity Jun 16 19:06:49.383036 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Connection: close Jun 16 19:06:49.383036 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Content-Length: 0 Jun 16 19:06:49.383036 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Content-Type: application/json Jun 16 19:06:49.383036 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Host: 10.222.0.70 Jun 16 19:06:49.383036 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Openstack-System-Scope: None Jun 16 19:06:49.383036 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: User-Agent: python-urllib3/1.26.9 Jun 16 19:06:49.383036 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Auth-Token: gAAAAABiq33NvA8ieVuAa42ktsxxMHUWPL2zeCJ5MrVnmc7AE0eg1Lni9faYH-HMZFRB5iMplBkzJbJ-6ZoXbZvwDDdY7IsOwuzE4zsZRM6rfpcaTKKkTnVsF9ATklbiAjxHpwhFGOeEmjtAA3VGsxp5_lB5SLLlEoRrzn9bD8Wc8hSUIO3hqjA Jun 16 19:06:49.383036 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Domain-Id: None Jun 16 19:06:49.383036 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Domain-Name: None Jun 16 19:06:49.383036 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Identity-Status: Confirmed Jun 16 19:06:49.383036 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Is-Admin-Project: True Jun 16 19:06:49.383036 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Domain-Id: default Jun 16 19:06:49.383036 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Domain-Name: Default Jun 16 19:06:49.383036 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Id: 629634dc3dc54893b68cb9c9dc08505d Jun 16 19:06:49.383036 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Name: tempest-TestShelveInstance-662201692 Jun 16 19:06:49.383036 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Role: member,reader Jun 16 19:06:49.383036 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Roles: member,reader Jun 16 19:06:49.384489 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/629634dc3dc54893b68cb9c9dc08505d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_629634dc3dc54893b68cb9c9dc08505d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/629634dc3dc54893b68cb9c9dc08505d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/629634dc3dc54893b68cb9c9dc08505d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 16 19:06:49.384489 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant: tempest-TestShelveInstance-662201692 Jun 16 19:06:49.384489 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant-Id: 629634dc3dc54893b68cb9c9dc08505d Jun 16 19:06:49.384489 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant-Name: tempest-TestShelveInstance-662201692 Jun 16 19:06:49.384489 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User: tempest-TestShelveInstance-662201692-project Jun 16 19:06:49.384489 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Domain-Id: default Jun 16 19:06:49.384489 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Domain-Name: Default Jun 16 19:06:49.384489 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Id: 27db09b804fa426a83f103cf5dd116a8 Jun 16 19:06:49.384489 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Name: tempest-TestShelveInstance-662201692-project Jun 16 19:06:49.384489 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: method: > Jun 16 19:06:49.384489 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: exception: Instance c4277200-c999-4c53-85de-b2a8b120cd6d could not be found. Jun 16 19:06:49.384489 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: action_args: {'id': 'c4277200-c999-4c53-85de-b2a8b120cd6d'} Jun 16 19:06:49.385310 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:06:49.385310 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:06:49.385310 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:06:49.385310 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:06:49.385310 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:06:49.385310 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:06:49.385310 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:06:49.385310 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:06:49.385310 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:06:49.385310 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:06:49.385310 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4277200-c999-4c53-85de-b2a8b120cd6d could not be found. Jun 16 19:06:49.385310 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:06:49.385310 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:06:49.385310 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:06:49.385310 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:06:49.385310 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:06:49.385310 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:06:49.385310 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:06:49.385310 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:06:49.385310 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:06:49.386681 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:06:49.386681 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:06:49.386681 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:06:49.386681 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:06:49.386681 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:06:49.386681 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:06:49.386681 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:06:49.386681 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4277200-c999-4c53-85de-b2a8b120cd6d could not be found. Jun 16 19:06:49.386681 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:06:49.386681 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:06:49.386681 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:06:49.386681 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:06:49.386681 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:06:49.386681 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:06:49.386681 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:06:49.386681 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:06:49.386681 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4277200-c999-4c53-85de-b2a8b120cd6d could not be found. Jun 16 19:06:49.386681 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:06:49.388377 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-97f1874d-3d2c-4739-be78-c9cafa9ab276 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Returning 404 to user: Instance c4277200-c999-4c53-85de-b2a8b120cd6d could not be found. {{(pid=117852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:06:49.388377 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-97f1874d-3d2c-4739-be78-c9cafa9ab276 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] 10.222.0.70 "GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d" status: 404 len: 111 microversion: 2.1 time: 0.034609 Jun 16 19:06:49.388621 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 455/895] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:06:49 2022] GET /compute/v2.1/servers/c4277200-c999-4c53-85de-b2a8b120cd6d => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 19:06:49.549826 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-5f6dc12c-3d12-4e7e-ad5f-58e3f3b26a67 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] Calling method '.version_select at 0x7f12e5e40c10>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:49.571641 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-5f6dc12c-3d12-4e7e-ad5f-58e3f3b26a67 tempest-TestShelveInstance-662201692 tempest-TestShelveInstance-662201692-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-316787948" status: 202 len: 0 microversion: 2.1 time: 0.026664 Jun 16 19:06:49.572211 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 441/896] 10.222.0.70 () {58 vars in 1250 bytes} [Thu Jun 16 19:06:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-316787948 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:06:50.471646 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-f1c33df8-a818-48dc-9956-342c2c7688fd tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:50.472227 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-f1c33df8-a818-48dc-9956-342c2c7688fd tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 6c2833a5-6276-4288-8c3e-1e82a8a2cca5] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:50.478733 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f1c33df8-a818-48dc-9956-342c2c7688fd tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:50.479180 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f1c33df8-a818-48dc-9956-342c2c7688fd tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:50.479936 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f1c33df8-a818-48dc-9956-342c2c7688fd tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:50.480371 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f1c33df8-a818-48dc-9956-342c2c7688fd tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:50.512727 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-f1c33df8-a818-48dc-9956-342c2c7688fd tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/6c2833a5-6276-4288-8c3e-1e82a8a2cca5/os-volume_attachments/947d810e-465d-41b8-bee7-3ac2db31fb6e" status: 200 len: 194 microversion: 2.1 time: 0.045584 Jun 16 19:06:50.513574 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 456/897] 10.222.0.70 () {58 vars in 1412 bytes} [Thu Jun 16 19:06:50 2022] GET /compute/v2.1/servers/6c2833a5-6276-4288-8c3e-1e82a8a2cca5/os-volume_attachments/947d810e-465d-41b8-bee7-3ac2db31fb6e => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:06:50.524659 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-5f34479d-2244-4e8e-883b-eab8be5e2676 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:50.525270 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-5f34479d-2244-4e8e-883b-eab8be5e2676 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 6c2833a5-6276-4288-8c3e-1e82a8a2cca5] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:50.532315 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-5f34479d-2244-4e8e-883b-eab8be5e2676 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:50.532768 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-5f34479d-2244-4e8e-883b-eab8be5e2676 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:50.533533 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-5f34479d-2244-4e8e-883b-eab8be5e2676 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:50.533977 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-5f34479d-2244-4e8e-883b-eab8be5e2676 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:50.626320 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.objects.instance [None req-5f34479d-2244-4e8e-883b-eab8be5e2676 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lazy-loading 'services' on Instance uuid 6c2833a5-6276-4288-8c3e-1e82a8a2cca5 {{(pid=117850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:06:50.711860 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-5f34479d-2244-4e8e-883b-eab8be5e2676 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "DELETE /compute/v2.1/servers/6c2833a5-6276-4288-8c3e-1e82a8a2cca5/os-volume_attachments/947d810e-465d-41b8-bee7-3ac2db31fb6e" status: 202 len: 0 microversion: 2.1 time: 0.191824 Jun 16 19:06:50.712735 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 442/898] 10.222.0.70 () {58 vars in 1415 bytes} [Thu Jun 16 19:06:50 2022] DELETE /compute/v2.1/servers/6c2833a5-6276-4288-8c3e-1e82a8a2cca5/os-volume_attachments/947d810e-465d-41b8-bee7-3ac2db31fb6e => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 19:06:51.895623 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-d08a0608-e83f-4f66-bfde-7719a6f94686 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:51.896653 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-d08a0608-e83f-4f66-bfde-7719a6f94686 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 6c2833a5-6276-4288-8c3e-1e82a8a2cca5] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:51.898957 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:06:51.904882 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d08a0608-e83f-4f66-bfde-7719a6f94686 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:51.905328 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d08a0608-e83f-4f66-bfde-7719a6f94686 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:51.906280 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d08a0608-e83f-4f66-bfde-7719a6f94686 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:51.906660 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d08a0608-e83f-4f66-bfde-7719a6f94686 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:51.937598 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-d08a0608-e83f-4f66-bfde-7719a6f94686 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/6c2833a5-6276-4288-8c3e-1e82a8a2cca5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046037 Jun 16 19:06:51.938214 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 457/899] 10.222.0.70 () {58 vars in 1301 bytes} [Thu Jun 16 19:06:51 2022] GET /compute/v2.1/servers/6c2833a5-6276-4288-8c3e-1e82a8a2cca5/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 19:06:52.045755 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-e47abf01-7e93-4aaf-918f-814e88da38e7 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:52.047174 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-e47abf01-7e93-4aaf-918f-814e88da38e7 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 6c2833a5-6276-4288-8c3e-1e82a8a2cca5] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:52.049500 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:06:52.054766 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-e47abf01-7e93-4aaf-918f-814e88da38e7 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:52.055252 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-e47abf01-7e93-4aaf-918f-814e88da38e7 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:52.056035 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-e47abf01-7e93-4aaf-918f-814e88da38e7 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:52.056472 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-e47abf01-7e93-4aaf-918f-814e88da38e7 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:52.090706 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-e47abf01-7e93-4aaf-918f-814e88da38e7 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/6c2833a5-6276-4288-8c3e-1e82a8a2cca5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049776 Jun 16 19:06:52.091456 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 443/900] 10.222.0.70 () {58 vars in 1301 bytes} [Thu Jun 16 19:06:52 2022] GET /compute/v2.1/servers/6c2833a5-6276-4288-8c3e-1e82a8a2cca5/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 19:06:52.157921 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-4cebba2a-dd81-4cd6-bbf1-3d34d9efac6a tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:52.158419 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-4cebba2a-dd81-4cd6-bbf1-3d34d9efac6a tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 6c2833a5-6276-4288-8c3e-1e82a8a2cca5] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:52.164608 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-4cebba2a-dd81-4cd6-bbf1-3d34d9efac6a tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:52.165055 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-4cebba2a-dd81-4cd6-bbf1-3d34d9efac6a tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:52.165816 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-4cebba2a-dd81-4cd6-bbf1-3d34d9efac6a tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:52.166247 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-4cebba2a-dd81-4cd6-bbf1-3d34d9efac6a tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:52.196808 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-4cebba2a-dd81-4cd6-bbf1-3d34d9efac6a tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 6c2833a5-6276-4288-8c3e-1e82a8a2cca5] Going to try to terminate instance {{(pid=117852) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:06:52.275320 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-4cebba2a-dd81-4cd6-bbf1-3d34d9efac6a tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "DELETE /compute/v2.1/servers/6c2833a5-6276-4288-8c3e-1e82a8a2cca5" status: 204 len: 0 microversion: 2.1 time: 0.121213 Jun 16 19:06:52.276532 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 458/901] 10.222.0.70 () {58 vars in 1238 bytes} [Thu Jun 16 19:06:52 2022] DELETE /compute/v2.1/servers/6c2833a5-6276-4288-8c3e-1e82a8a2cca5 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:06:52.285086 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-723590f4-9bf5-4c41-84fc-46211d0339ff tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:52.286175 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-723590f4-9bf5-4c41-84fc-46211d0339ff tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 6c2833a5-6276-4288-8c3e-1e82a8a2cca5] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:52.292775 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-723590f4-9bf5-4c41-84fc-46211d0339ff tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:52.293301 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-723590f4-9bf5-4c41-84fc-46211d0339ff tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:52.294100 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-723590f4-9bf5-4c41-84fc-46211d0339ff tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:52.294743 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-723590f4-9bf5-4c41-84fc-46211d0339ff tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:52.520523 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-723590f4-9bf5-4c41-84fc-46211d0339ff tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:52.530784 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-723590f4-9bf5-4c41-84fc-46211d0339ff tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/6c2833a5-6276-4288-8c3e-1e82a8a2cca5" status: 200 len: 1674 microversion: 2.1 time: 0.248512 Jun 16 19:06:52.531933 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 444/902] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:06:52 2022] GET /compute/v2.1/servers/6c2833a5-6276-4288-8c3e-1e82a8a2cca5 => generated 1674 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:06:53.550143 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-ef0cedc9-6403-4814-8fe1-b632c2f7bd4b tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:53.550874 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-ef0cedc9-6403-4814-8fe1-b632c2f7bd4b tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 6c2833a5-6276-4288-8c3e-1e82a8a2cca5] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:53.558158 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ef0cedc9-6403-4814-8fe1-b632c2f7bd4b tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:53.558614 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ef0cedc9-6403-4814-8fe1-b632c2f7bd4b tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:53.559449 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ef0cedc9-6403-4814-8fe1-b632c2f7bd4b tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:53.559884 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ef0cedc9-6403-4814-8fe1-b632c2f7bd4b tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:53.812190 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-ef0cedc9-6403-4814-8fe1-b632c2f7bd4b tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:53.821726 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-ef0cedc9-6403-4814-8fe1-b632c2f7bd4b tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/6c2833a5-6276-4288-8c3e-1e82a8a2cca5" status: 200 len: 1674 microversion: 2.1 time: 0.276963 Jun 16 19:06:53.822392 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 459/903] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:06:53 2022] GET /compute/v2.1/servers/6c2833a5-6276-4288-8c3e-1e82a8a2cca5 => generated 1674 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:06:54.842392 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-20bf5396-d00d-4728-93c9-2464cb5b77ad tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:54.844025 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-20bf5396-d00d-4728-93c9-2464cb5b77ad tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 6c2833a5-6276-4288-8c3e-1e82a8a2cca5] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:54.851072 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-20bf5396-d00d-4728-93c9-2464cb5b77ad tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:54.851612 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-20bf5396-d00d-4728-93c9-2464cb5b77ad tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:54.852468 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-20bf5396-d00d-4728-93c9-2464cb5b77ad tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:54.852974 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-20bf5396-d00d-4728-93c9-2464cb5b77ad tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:54.857301 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:06:55.070219 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-20bf5396-d00d-4728-93c9-2464cb5b77ad tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:55.079136 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-20bf5396-d00d-4728-93c9-2464cb5b77ad tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/6c2833a5-6276-4288-8c3e-1e82a8a2cca5" status: 200 len: 1674 microversion: 2.1 time: 0.241581 Jun 16 19:06:55.089172 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 445/904] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:06:54 2022] GET /compute/v2.1/servers/6c2833a5-6276-4288-8c3e-1e82a8a2cca5 => generated 1674 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:06:55.584014 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [req-d6810513-5655-4fc8-9e3e-cef27be1e645 req-24c10203-e4bc-4ed2-9a41-61cd350f7745 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c2833a5-6276-4288-8c3e-1e82a8a2cca5", "name": "network-vif-deleted", "tag": "ff5aa27e-cd5d-417e-9860-45906e62e4f9"}]} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:06:55.593515 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-d6810513-5655-4fc8-9e3e-cef27be1e645 req-24c10203-e4bc-4ed2-9a41-61cd350f7745 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:55.594167 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-d6810513-5655-4fc8-9e3e-cef27be1e645 req-24c10203-e4bc-4ed2-9a41-61cd350f7745 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:55.613621 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.compute.server_external_events [req-d6810513-5655-4fc8-9e3e-cef27be1e645 req-24c10203-e4bc-4ed2-9a41-61cd350f7745 service nova] Creating event network-vif-deleted:ff5aa27e-cd5d-417e-9860-45906e62e4f9 for instance 6c2833a5-6276-4288-8c3e-1e82a8a2cca5 on hv-cinder-84617 Jun 16 19:06:55.620293 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [req-d6810513-5655-4fc8-9e3e-cef27be1e645 req-24c10203-e4bc-4ed2-9a41-61cd350f7745 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040699 Jun 16 19:06:55.621458 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 460/905] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:06:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:06:56.096875 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-2c30bf8f-7d5d-4592-965c-35586e38517f tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:56.098015 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-2c30bf8f-7d5d-4592-965c-35586e38517f tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 6c2833a5-6276-4288-8c3e-1e82a8a2cca5] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:56.105048 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-2c30bf8f-7d5d-4592-965c-35586e38517f tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:56.105527 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-2c30bf8f-7d5d-4592-965c-35586e38517f tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:56.106491 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-2c30bf8f-7d5d-4592-965c-35586e38517f tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:56.107136 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-2c30bf8f-7d5d-4592-965c-35586e38517f tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:56.145744 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-2c30bf8f-7d5d-4592-965c-35586e38517f tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:56.146349 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-2c30bf8f-7d5d-4592-965c-35586e38517f tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:56.146843 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.objects.instance [None req-2c30bf8f-7d5d-4592-965c-35586e38517f tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lazy-loading 'fault' on Instance uuid 6c2833a5-6276-4288-8c3e-1e82a8a2cca5 {{(pid=117850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:06:56.197053 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-2c30bf8f-7d5d-4592-965c-35586e38517f tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8742a73e9b4f46deb0b5c9e1756ffe2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd865cf7b3e5c4291a0204f396143083a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:06:56.206724 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-2c30bf8f-7d5d-4592-965c-35586e38517f tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/6c2833a5-6276-4288-8c3e-1e82a8a2cca5" status: 200 len: 1328 microversion: 2.1 time: 0.114348 Jun 16 19:06:56.214745 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 446/906] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:06:56 2022] GET /compute/v2.1/servers/6c2833a5-6276-4288-8c3e-1e82a8a2cca5 => generated 1328 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:06:57.229429 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-8f4adf97-f2d2-4788-9ca2-bde6d2eff044 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:57.230767 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-8f4adf97-f2d2-4788-9ca2-bde6d2eff044 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 6c2833a5-6276-4288-8c3e-1e82a8a2cca5] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:06:57.238300 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-8f4adf97-f2d2-4788-9ca2-bde6d2eff044 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:57.238785 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-8f4adf97-f2d2-4788-9ca2-bde6d2eff044 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:57.239557 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-8f4adf97-f2d2-4788-9ca2-bde6d2eff044 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:06:57.240128 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-8f4adf97-f2d2-4788-9ca2-bde6d2eff044 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:06:57.258911 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.wsgi [None req-8f4adf97-f2d2-4788-9ca2-bde6d2eff044 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] HTTP exception thrown: Instance 6c2833a5-6276-4288-8c3e-1e82a8a2cca5 could not be found. Jun 16 19:06:57.260936 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-8f4adf97-f2d2-4788-9ca2-bde6d2eff044 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Request method failure captured: Jun 16 19:06:57.260936 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: request: GET /compute/v2.1/servers/6c2833a5-6276-4288-8c3e-1e82a8a2cca5 HTTP/1.1 Jun 16 19:06:57.260936 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Accept: application/json Jun 16 19:06:57.260936 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Accept-Encoding: identity Jun 16 19:06:57.260936 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Connection: close Jun 16 19:06:57.260936 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Content-Length: 0 Jun 16 19:06:57.260936 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Content-Type: application/json Jun 16 19:06:57.260936 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Host: 10.222.0.70 Jun 16 19:06:57.260936 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Openstack-System-Scope: None Jun 16 19:06:57.260936 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: User-Agent: python-urllib3/1.26.9 Jun 16 19:06:57.260936 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Auth-Token: gAAAAABiq32STCJaFXQIp3PzTnZvjl6lE_TcopJhXajXolWMvtX8Nbvxxl2A6BOWdIBYcRqB6SjqOixF3IkG5t1y9pUrVisaB_7h8Kf0i8llu-5_RZzAvGw7ssMl3iqktVqv-nmWcZYep8Ah7GhViBFc9b5VQfaEW_2jV08YDm-3GpmhGdUWTyY Jun 16 19:06:57.260936 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Domain-Id: None Jun 16 19:06:57.260936 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Domain-Name: None Jun 16 19:06:57.260936 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Identity-Status: Confirmed Jun 16 19:06:57.260936 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Is-Admin-Project: True Jun 16 19:06:57.260936 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Domain-Id: default Jun 16 19:06:57.260936 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Domain-Name: Default Jun 16 19:06:57.260936 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Id: d865cf7b3e5c4291a0204f396143083a Jun 16 19:06:57.260936 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Name: tempest-AttachVolumeTestJSON-932291825 Jun 16 19:06:57.260936 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Role: member,reader Jun 16 19:06:57.260936 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Roles: member,reader Jun 16 19:06:57.262697 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d865cf7b3e5c4291a0204f396143083a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d865cf7b3e5c4291a0204f396143083a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d865cf7b3e5c4291a0204f396143083a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d865cf7b3e5c4291a0204f396143083a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 16 19:06:57.262697 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant: tempest-AttachVolumeTestJSON-932291825 Jun 16 19:06:57.262697 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant-Id: d865cf7b3e5c4291a0204f396143083a Jun 16 19:06:57.262697 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant-Name: tempest-AttachVolumeTestJSON-932291825 Jun 16 19:06:57.262697 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User: tempest-AttachVolumeTestJSON-932291825-project Jun 16 19:06:57.262697 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Domain-Id: default Jun 16 19:06:57.262697 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Domain-Name: Default Jun 16 19:06:57.262697 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Id: 8742a73e9b4f46deb0b5c9e1756ffe2e Jun 16 19:06:57.262697 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Name: tempest-AttachVolumeTestJSON-932291825-project Jun 16 19:06:57.262697 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: method: > Jun 16 19:06:57.262697 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: exception: Instance 6c2833a5-6276-4288-8c3e-1e82a8a2cca5 could not be found. Jun 16 19:06:57.262697 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: action_args: {'id': '6c2833a5-6276-4288-8c3e-1e82a8a2cca5'} Jun 16 19:06:57.275015 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:06:57.275015 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:06:57.275015 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:06:57.275015 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:06:57.275015 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:06:57.275015 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:06:57.275015 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:06:57.275015 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:06:57.275015 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:06:57.275015 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:06:57.275015 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c2833a5-6276-4288-8c3e-1e82a8a2cca5 could not be found. Jun 16 19:06:57.275015 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:06:57.275015 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:06:57.275015 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:06:57.275015 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:06:57.275015 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:06:57.275015 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:06:57.275015 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:06:57.275015 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:06:57.275015 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:06:57.277607 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:06:57.277607 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:06:57.277607 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:06:57.277607 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:06:57.277607 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:06:57.277607 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:06:57.277607 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:06:57.277607 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c2833a5-6276-4288-8c3e-1e82a8a2cca5 could not be found. Jun 16 19:06:57.277607 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:06:57.277607 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:06:57.277607 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:06:57.277607 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:06:57.277607 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:06:57.277607 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:06:57.277607 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:06:57.277607 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:06:57.277607 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c2833a5-6276-4288-8c3e-1e82a8a2cca5 could not be found. Jun 16 19:06:57.277607 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:06:57.279116 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-8f4adf97-f2d2-4788-9ca2-bde6d2eff044 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Returning 404 to user: Instance 6c2833a5-6276-4288-8c3e-1e82a8a2cca5 could not be found. {{(pid=117852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:06:57.279116 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-8f4adf97-f2d2-4788-9ca2-bde6d2eff044 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/6c2833a5-6276-4288-8c3e-1e82a8a2cca5" status: 404 len: 111 microversion: 2.1 time: 0.037819 Jun 16 19:06:57.279116 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 461/907] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:06:57 2022] GET /compute/v2.1/servers/6c2833a5-6276-4288-8c3e-1e82a8a2cca5 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:06:57.279360 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-456325dc-74dc-4597-aafe-91ba7830f200 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '.version_select at 0x7f12e5e40430>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:06:57.291679 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-456325dc-74dc-4597-aafe-91ba7830f200 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1754353307" status: 202 len: 0 microversion: 2.1 time: 0.022967 Jun 16 19:06:57.295694 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 447/908] 10.222.0.70 () {58 vars in 1220 bytes} [Thu Jun 16 19:06:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1754353307 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:07:00.323899 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-a7de3fb3-9677-4b4c-b289-0a3537cf077f tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:00.324400 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-a7de3fb3-9677-4b4c-b289-0a3537cf077f tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 6c2833a5-6276-4288-8c3e-1e82a8a2cca5] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:00.331060 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-a7de3fb3-9677-4b4c-b289-0a3537cf077f tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:00.331513 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-a7de3fb3-9677-4b4c-b289-0a3537cf077f tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:00.332312 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-a7de3fb3-9677-4b4c-b289-0a3537cf077f tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:00.332749 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-a7de3fb3-9677-4b4c-b289-0a3537cf077f tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:00.346987 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.wsgi [None req-a7de3fb3-9677-4b4c-b289-0a3537cf077f tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] HTTP exception thrown: Instance 6c2833a5-6276-4288-8c3e-1e82a8a2cca5 could not be found. Jun 16 19:07:00.348527 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-a7de3fb3-9677-4b4c-b289-0a3537cf077f tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Request method failure captured: Jun 16 19:07:00.348527 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: request: DELETE /compute/v2.1/servers/6c2833a5-6276-4288-8c3e-1e82a8a2cca5 HTTP/1.1 Jun 16 19:07:00.348527 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Accept: application/json Jun 16 19:07:00.348527 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Accept-Encoding: identity Jun 16 19:07:00.348527 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Connection: close Jun 16 19:07:00.348527 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Content-Length: 0 Jun 16 19:07:00.348527 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Content-Type: application/json Jun 16 19:07:00.348527 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Host: 10.222.0.70 Jun 16 19:07:00.348527 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Openstack-System-Scope: None Jun 16 19:07:00.348527 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: User-Agent: python-urllib3/1.26.9 Jun 16 19:07:00.348527 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Auth-Token: gAAAAABiq32STCJaFXQIp3PzTnZvjl6lE_TcopJhXajXolWMvtX8Nbvxxl2A6BOWdIBYcRqB6SjqOixF3IkG5t1y9pUrVisaB_7h8Kf0i8llu-5_RZzAvGw7ssMl3iqktVqv-nmWcZYep8Ah7GhViBFc9b5VQfaEW_2jV08YDm-3GpmhGdUWTyY Jun 16 19:07:00.348527 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Domain-Id: None Jun 16 19:07:00.348527 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Domain-Name: None Jun 16 19:07:00.348527 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Identity-Status: Confirmed Jun 16 19:07:00.348527 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Is-Admin-Project: True Jun 16 19:07:00.348527 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Domain-Id: default Jun 16 19:07:00.348527 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Domain-Name: Default Jun 16 19:07:00.348527 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Id: d865cf7b3e5c4291a0204f396143083a Jun 16 19:07:00.348527 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Name: tempest-AttachVolumeTestJSON-932291825 Jun 16 19:07:00.348527 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Role: member,reader Jun 16 19:07:00.348527 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Roles: member,reader Jun 16 19:07:00.350132 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d865cf7b3e5c4291a0204f396143083a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d865cf7b3e5c4291a0204f396143083a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d865cf7b3e5c4291a0204f396143083a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d865cf7b3e5c4291a0204f396143083a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 16 19:07:00.350132 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant: tempest-AttachVolumeTestJSON-932291825 Jun 16 19:07:00.350132 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant-Id: d865cf7b3e5c4291a0204f396143083a Jun 16 19:07:00.350132 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant-Name: tempest-AttachVolumeTestJSON-932291825 Jun 16 19:07:00.350132 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User: tempest-AttachVolumeTestJSON-932291825-project Jun 16 19:07:00.350132 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Domain-Id: default Jun 16 19:07:00.350132 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Domain-Name: Default Jun 16 19:07:00.350132 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Id: 8742a73e9b4f46deb0b5c9e1756ffe2e Jun 16 19:07:00.350132 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Name: tempest-AttachVolumeTestJSON-932291825-project Jun 16 19:07:00.350132 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: method: > Jun 16 19:07:00.350132 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: exception: Instance 6c2833a5-6276-4288-8c3e-1e82a8a2cca5 could not be found. Jun 16 19:07:00.350132 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: action_args: {'id': '6c2833a5-6276-4288-8c3e-1e82a8a2cca5'} Jun 16 19:07:00.351131 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:07:00.351131 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:07:00.351131 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:07:00.351131 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:07:00.351131 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:07:00.351131 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:07:00.351131 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:07:00.351131 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:07:00.351131 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:07:00.351131 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:07:00.351131 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c2833a5-6276-4288-8c3e-1e82a8a2cca5 could not be found. Jun 16 19:07:00.351131 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:07:00.351131 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:07:00.351131 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:07:00.351131 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:07:00.351131 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:07:00.351131 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:07:00.351131 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:07:00.351131 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:07:00.351131 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:07:00.352375 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:07:00.352375 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 19:07:00.352375 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 19:07:00.352375 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 19:07:00.352375 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 19:07:00.352375 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:07:00.352375 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:07:00.352375 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:07:00.352375 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:07:00.352375 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c2833a5-6276-4288-8c3e-1e82a8a2cca5 could not be found. Jun 16 19:07:00.352375 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:07:00.352375 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:07:00.352375 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:07:00.352375 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:07:00.352375 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:07:00.352375 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:07:00.352375 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:07:00.352375 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:07:00.352375 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c2833a5-6276-4288-8c3e-1e82a8a2cca5 could not be found. Jun 16 19:07:00.352375 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:07:00.353795 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-a7de3fb3-9677-4b4c-b289-0a3537cf077f tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Returning 404 to user: Instance 6c2833a5-6276-4288-8c3e-1e82a8a2cca5 could not be found. {{(pid=117852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:07:00.353795 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-a7de3fb3-9677-4b4c-b289-0a3537cf077f tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "DELETE /compute/v2.1/servers/6c2833a5-6276-4288-8c3e-1e82a8a2cca5" status: 404 len: 111 microversion: 2.1 time: 0.030105 Jun 16 19:07:00.353795 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 462/909] 10.222.0.70 () {58 vars in 1238 bytes} [Thu Jun 16 19:07:00 2022] DELETE /compute/v2.1/servers/6c2833a5-6276-4288-8c3e-1e82a8a2cca5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 19:07:00.359752 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-3fc6ea2d-5ee4-4314-9c5c-348e3e1dafa4 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:00.360379 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-3fc6ea2d-5ee4-4314-9c5c-348e3e1dafa4 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 6c2833a5-6276-4288-8c3e-1e82a8a2cca5] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:00.366391 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-3fc6ea2d-5ee4-4314-9c5c-348e3e1dafa4 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:00.366877 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-3fc6ea2d-5ee4-4314-9c5c-348e3e1dafa4 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:00.367643 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-3fc6ea2d-5ee4-4314-9c5c-348e3e1dafa4 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:00.368082 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-3fc6ea2d-5ee4-4314-9c5c-348e3e1dafa4 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:00.381401 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.wsgi [None req-3fc6ea2d-5ee4-4314-9c5c-348e3e1dafa4 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] HTTP exception thrown: Instance 6c2833a5-6276-4288-8c3e-1e82a8a2cca5 could not be found. Jun 16 19:07:00.383136 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-3fc6ea2d-5ee4-4314-9c5c-348e3e1dafa4 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Request method failure captured: Jun 16 19:07:00.383136 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: request: GET /compute/v2.1/servers/6c2833a5-6276-4288-8c3e-1e82a8a2cca5 HTTP/1.1 Jun 16 19:07:00.383136 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Accept: application/json Jun 16 19:07:00.383136 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Accept-Encoding: identity Jun 16 19:07:00.383136 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Connection: close Jun 16 19:07:00.383136 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Content-Length: 0 Jun 16 19:07:00.383136 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Content-Type: application/json Jun 16 19:07:00.383136 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Host: 10.222.0.70 Jun 16 19:07:00.383136 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Openstack-System-Scope: None Jun 16 19:07:00.383136 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: User-Agent: python-urllib3/1.26.9 Jun 16 19:07:00.383136 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Auth-Token: gAAAAABiq32STCJaFXQIp3PzTnZvjl6lE_TcopJhXajXolWMvtX8Nbvxxl2A6BOWdIBYcRqB6SjqOixF3IkG5t1y9pUrVisaB_7h8Kf0i8llu-5_RZzAvGw7ssMl3iqktVqv-nmWcZYep8Ah7GhViBFc9b5VQfaEW_2jV08YDm-3GpmhGdUWTyY Jun 16 19:07:00.383136 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Domain-Id: None Jun 16 19:07:00.383136 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Domain-Name: None Jun 16 19:07:00.383136 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Identity-Status: Confirmed Jun 16 19:07:00.383136 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Is-Admin-Project: True Jun 16 19:07:00.383136 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Domain-Id: default Jun 16 19:07:00.383136 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Domain-Name: Default Jun 16 19:07:00.383136 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Id: d865cf7b3e5c4291a0204f396143083a Jun 16 19:07:00.383136 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Name: tempest-AttachVolumeTestJSON-932291825 Jun 16 19:07:00.383136 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Role: member,reader Jun 16 19:07:00.383136 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Roles: member,reader Jun 16 19:07:00.384678 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d865cf7b3e5c4291a0204f396143083a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d865cf7b3e5c4291a0204f396143083a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d865cf7b3e5c4291a0204f396143083a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d865cf7b3e5c4291a0204f396143083a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 16 19:07:00.384678 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant: tempest-AttachVolumeTestJSON-932291825 Jun 16 19:07:00.384678 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant-Id: d865cf7b3e5c4291a0204f396143083a Jun 16 19:07:00.384678 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant-Name: tempest-AttachVolumeTestJSON-932291825 Jun 16 19:07:00.384678 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User: tempest-AttachVolumeTestJSON-932291825-project Jun 16 19:07:00.384678 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Domain-Id: default Jun 16 19:07:00.384678 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Domain-Name: Default Jun 16 19:07:00.384678 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Id: 8742a73e9b4f46deb0b5c9e1756ffe2e Jun 16 19:07:00.384678 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Name: tempest-AttachVolumeTestJSON-932291825-project Jun 16 19:07:00.384678 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: method: > Jun 16 19:07:00.384678 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: exception: Instance 6c2833a5-6276-4288-8c3e-1e82a8a2cca5 could not be found. Jun 16 19:07:00.384678 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: action_args: {'id': '6c2833a5-6276-4288-8c3e-1e82a8a2cca5'} Jun 16 19:07:00.385801 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:07:00.385801 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:07:00.385801 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:07:00.385801 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:07:00.385801 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:07:00.385801 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:07:00.385801 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:07:00.385801 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:07:00.385801 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:07:00.385801 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:07:00.385801 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c2833a5-6276-4288-8c3e-1e82a8a2cca5 could not be found. Jun 16 19:07:00.385801 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:07:00.385801 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:07:00.385801 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:07:00.385801 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:07:00.385801 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:07:00.385801 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:07:00.385801 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:07:00.385801 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:07:00.385801 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:07:00.387332 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:07:00.387332 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:07:00.387332 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:07:00.387332 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:07:00.387332 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:07:00.387332 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:07:00.387332 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:07:00.387332 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c2833a5-6276-4288-8c3e-1e82a8a2cca5 could not be found. Jun 16 19:07:00.387332 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:07:00.387332 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:07:00.387332 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:07:00.387332 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:07:00.387332 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:07:00.387332 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:07:00.387332 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:07:00.387332 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:07:00.387332 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c2833a5-6276-4288-8c3e-1e82a8a2cca5 could not be found. Jun 16 19:07:00.387332 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:07:00.389408 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-3fc6ea2d-5ee4-4314-9c5c-348e3e1dafa4 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Returning 404 to user: Instance 6c2833a5-6276-4288-8c3e-1e82a8a2cca5 could not be found. {{(pid=117850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:07:00.389408 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-3fc6ea2d-5ee4-4314-9c5c-348e3e1dafa4 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/6c2833a5-6276-4288-8c3e-1e82a8a2cca5" status: 404 len: 111 microversion: 2.1 time: 0.030110 Jun 16 19:07:00.389408 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 448/910] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:07:00 2022] GET /compute/v2.1/servers/6c2833a5-6276-4288-8c3e-1e82a8a2cca5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:07:01.525973 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-4338c5f9-892c-475b-89e3-0b48fcda5390 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:01.526466 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-4338c5f9-892c-475b-89e3-0b48fcda5390 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:01.533338 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-4338c5f9-892c-475b-89e3-0b48fcda5390 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:01.533789 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-4338c5f9-892c-475b-89e3-0b48fcda5390 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:01.534540 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-4338c5f9-892c-475b-89e3-0b48fcda5390 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:01.535028 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-4338c5f9-892c-475b-89e3-0b48fcda5390 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:01.548524 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.wsgi [None req-4338c5f9-892c-475b-89e3-0b48fcda5390 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] HTTP exception thrown: Instance 2fb4cc0a-23a8-417c-a8a1-35501c2690ee could not be found. Jun 16 19:07:01.550052 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-4338c5f9-892c-475b-89e3-0b48fcda5390 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Request method failure captured: Jun 16 19:07:01.550052 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: request: DELETE /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee HTTP/1.1 Jun 16 19:07:01.550052 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Accept: application/json Jun 16 19:07:01.550052 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Accept-Encoding: identity Jun 16 19:07:01.550052 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Connection: close Jun 16 19:07:01.550052 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Content-Length: 0 Jun 16 19:07:01.550052 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Content-Type: application/json Jun 16 19:07:01.550052 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Host: 10.222.0.70 Jun 16 19:07:01.550052 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Openstack-System-Scope: None Jun 16 19:07:01.550052 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: User-Agent: python-urllib3/1.26.9 Jun 16 19:07:01.550052 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Auth-Token: gAAAAABiq32STCJaFXQIp3PzTnZvjl6lE_TcopJhXajXolWMvtX8Nbvxxl2A6BOWdIBYcRqB6SjqOixF3IkG5t1y9pUrVisaB_7h8Kf0i8llu-5_RZzAvGw7ssMl3iqktVqv-nmWcZYep8Ah7GhViBFc9b5VQfaEW_2jV08YDm-3GpmhGdUWTyY Jun 16 19:07:01.550052 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Domain-Id: None Jun 16 19:07:01.550052 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Domain-Name: None Jun 16 19:07:01.550052 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Identity-Status: Confirmed Jun 16 19:07:01.550052 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Is-Admin-Project: True Jun 16 19:07:01.550052 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Domain-Id: default Jun 16 19:07:01.550052 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Domain-Name: Default Jun 16 19:07:01.550052 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Id: d865cf7b3e5c4291a0204f396143083a Jun 16 19:07:01.550052 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Name: tempest-AttachVolumeTestJSON-932291825 Jun 16 19:07:01.550052 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Role: member,reader Jun 16 19:07:01.550052 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Roles: member,reader Jun 16 19:07:01.551693 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d865cf7b3e5c4291a0204f396143083a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d865cf7b3e5c4291a0204f396143083a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d865cf7b3e5c4291a0204f396143083a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d865cf7b3e5c4291a0204f396143083a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 16 19:07:01.551693 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant: tempest-AttachVolumeTestJSON-932291825 Jun 16 19:07:01.551693 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant-Id: d865cf7b3e5c4291a0204f396143083a Jun 16 19:07:01.551693 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant-Name: tempest-AttachVolumeTestJSON-932291825 Jun 16 19:07:01.551693 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User: tempest-AttachVolumeTestJSON-932291825-project Jun 16 19:07:01.551693 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Domain-Id: default Jun 16 19:07:01.551693 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Domain-Name: Default Jun 16 19:07:01.551693 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Id: 8742a73e9b4f46deb0b5c9e1756ffe2e Jun 16 19:07:01.551693 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Name: tempest-AttachVolumeTestJSON-932291825-project Jun 16 19:07:01.551693 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: method: > Jun 16 19:07:01.551693 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: exception: Instance 2fb4cc0a-23a8-417c-a8a1-35501c2690ee could not be found. Jun 16 19:07:01.551693 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: action_args: {'id': '2fb4cc0a-23a8-417c-a8a1-35501c2690ee'} Jun 16 19:07:01.552576 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:07:01.552576 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:07:01.552576 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:07:01.552576 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:07:01.552576 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:07:01.552576 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:07:01.552576 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:07:01.552576 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:07:01.552576 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:07:01.552576 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:07:01.552576 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fb4cc0a-23a8-417c-a8a1-35501c2690ee could not be found. Jun 16 19:07:01.552576 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:07:01.552576 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:07:01.552576 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:07:01.552576 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:07:01.552576 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:07:01.552576 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:07:01.552576 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:07:01.552576 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:07:01.552576 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:07:01.554046 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:07:01.554046 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 19:07:01.554046 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 19:07:01.554046 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 19:07:01.554046 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 19:07:01.554046 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:07:01.554046 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:07:01.554046 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:07:01.554046 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:07:01.554046 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fb4cc0a-23a8-417c-a8a1-35501c2690ee could not be found. Jun 16 19:07:01.554046 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:07:01.554046 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:07:01.554046 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:07:01.554046 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:07:01.554046 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:07:01.554046 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:07:01.554046 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:07:01.554046 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:07:01.554046 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fb4cc0a-23a8-417c-a8a1-35501c2690ee could not be found. Jun 16 19:07:01.554046 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:07:01.555526 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-4338c5f9-892c-475b-89e3-0b48fcda5390 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Returning 404 to user: Instance 2fb4cc0a-23a8-417c-a8a1-35501c2690ee could not be found. {{(pid=117852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:07:01.555526 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-4338c5f9-892c-475b-89e3-0b48fcda5390 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "DELETE /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 404 len: 111 microversion: 2.1 time: 0.029562 Jun 16 19:07:01.555526 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 463/911] 10.222.0.70 () {58 vars in 1238 bytes} [Thu Jun 16 19:07:01 2022] DELETE /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:07:01.559838 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-35180b5d-5c83-4b31-b12c-92ce2ee47533 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:01.561509 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-35180b5d-5c83-4b31-b12c-92ce2ee47533 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] [instance: 2fb4cc0a-23a8-417c-a8a1-35501c2690ee] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:01.567512 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-35180b5d-5c83-4b31-b12c-92ce2ee47533 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:01.567962 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-35180b5d-5c83-4b31-b12c-92ce2ee47533 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:01.568717 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-35180b5d-5c83-4b31-b12c-92ce2ee47533 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:01.569175 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-35180b5d-5c83-4b31-b12c-92ce2ee47533 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:01.582987 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.wsgi [None req-35180b5d-5c83-4b31-b12c-92ce2ee47533 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] HTTP exception thrown: Instance 2fb4cc0a-23a8-417c-a8a1-35501c2690ee could not be found. Jun 16 19:07:01.584473 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-35180b5d-5c83-4b31-b12c-92ce2ee47533 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Request method failure captured: Jun 16 19:07:01.584473 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: request: GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee HTTP/1.1 Jun 16 19:07:01.584473 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Accept: application/json Jun 16 19:07:01.584473 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Accept-Encoding: identity Jun 16 19:07:01.584473 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Connection: close Jun 16 19:07:01.584473 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Content-Length: 0 Jun 16 19:07:01.584473 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Content-Type: application/json Jun 16 19:07:01.584473 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Host: 10.222.0.70 Jun 16 19:07:01.584473 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Openstack-System-Scope: None Jun 16 19:07:01.584473 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: User-Agent: python-urllib3/1.26.9 Jun 16 19:07:01.584473 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Auth-Token: gAAAAABiq32STCJaFXQIp3PzTnZvjl6lE_TcopJhXajXolWMvtX8Nbvxxl2A6BOWdIBYcRqB6SjqOixF3IkG5t1y9pUrVisaB_7h8Kf0i8llu-5_RZzAvGw7ssMl3iqktVqv-nmWcZYep8Ah7GhViBFc9b5VQfaEW_2jV08YDm-3GpmhGdUWTyY Jun 16 19:07:01.584473 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Domain-Id: None Jun 16 19:07:01.584473 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Domain-Name: None Jun 16 19:07:01.584473 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Identity-Status: Confirmed Jun 16 19:07:01.584473 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Is-Admin-Project: True Jun 16 19:07:01.584473 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Domain-Id: default Jun 16 19:07:01.584473 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Domain-Name: Default Jun 16 19:07:01.584473 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Id: d865cf7b3e5c4291a0204f396143083a Jun 16 19:07:01.584473 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Name: tempest-AttachVolumeTestJSON-932291825 Jun 16 19:07:01.584473 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Role: member,reader Jun 16 19:07:01.584473 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Roles: member,reader Jun 16 19:07:01.586017 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d865cf7b3e5c4291a0204f396143083a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d865cf7b3e5c4291a0204f396143083a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d865cf7b3e5c4291a0204f396143083a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d865cf7b3e5c4291a0204f396143083a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 16 19:07:01.586017 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant: tempest-AttachVolumeTestJSON-932291825 Jun 16 19:07:01.586017 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant-Id: d865cf7b3e5c4291a0204f396143083a Jun 16 19:07:01.586017 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant-Name: tempest-AttachVolumeTestJSON-932291825 Jun 16 19:07:01.586017 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User: tempest-AttachVolumeTestJSON-932291825-project Jun 16 19:07:01.586017 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Domain-Id: default Jun 16 19:07:01.586017 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Domain-Name: Default Jun 16 19:07:01.586017 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Id: 8742a73e9b4f46deb0b5c9e1756ffe2e Jun 16 19:07:01.586017 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Name: tempest-AttachVolumeTestJSON-932291825-project Jun 16 19:07:01.586017 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: method: > Jun 16 19:07:01.586017 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: exception: Instance 2fb4cc0a-23a8-417c-a8a1-35501c2690ee could not be found. Jun 16 19:07:01.586017 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: action_args: {'id': '2fb4cc0a-23a8-417c-a8a1-35501c2690ee'} Jun 16 19:07:01.586951 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:07:01.586951 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:07:01.586951 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:07:01.586951 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:07:01.586951 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:07:01.586951 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:07:01.586951 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:07:01.586951 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:07:01.586951 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:07:01.586951 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:07:01.586951 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fb4cc0a-23a8-417c-a8a1-35501c2690ee could not be found. Jun 16 19:07:01.586951 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:07:01.586951 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:07:01.586951 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:07:01.586951 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:07:01.586951 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:07:01.586951 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:07:01.586951 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:07:01.586951 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:07:01.586951 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:07:01.588397 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:07:01.588397 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:07:01.588397 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:07:01.588397 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:07:01.588397 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:07:01.588397 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:07:01.588397 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:07:01.588397 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fb4cc0a-23a8-417c-a8a1-35501c2690ee could not be found. Jun 16 19:07:01.588397 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:07:01.588397 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:07:01.588397 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:07:01.588397 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:07:01.588397 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:07:01.588397 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:07:01.588397 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:07:01.588397 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:07:01.588397 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fb4cc0a-23a8-417c-a8a1-35501c2690ee could not be found. Jun 16 19:07:01.588397 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:07:01.589731 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-35180b5d-5c83-4b31-b12c-92ce2ee47533 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] Returning 404 to user: Instance 2fb4cc0a-23a8-417c-a8a1-35501c2690ee could not be found. {{(pid=117850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:07:01.589731 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-35180b5d-5c83-4b31-b12c-92ce2ee47533 tempest-AttachVolumeTestJSON-932291825 tempest-AttachVolumeTestJSON-932291825-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee" status: 404 len: 111 microversion: 2.1 time: 0.029768 Jun 16 19:07:01.589731 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 449/912] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:07:01 2022] GET /compute/v2.1/servers/2fb4cc0a-23a8-417c-a8a1-35501c2690ee => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 19:07:06.140519 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-48b69803-fbda-4e6d-a21c-7394b4a27e96 tempest-VolumesSnapshotsTestJSON-2133080244 tempest-VolumesSnapshotsTestJSON-2133080244-project] Action: 'create', calling method: .version_select at 0x7f12e5e8be50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-349619320"}} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:07:06.436499 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-48b69803-fbda-4e6d-a21c-7394b4a27e96 tempest-VolumesSnapshotsTestJSON-2133080244 tempest-VolumesSnapshotsTestJSON-2133080244-project] 10.222.0.70 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.409721 Jun 16 19:07:06.437234 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 464/913] 10.222.0.70 () {60 vars in 1154 bytes} [Thu Jun 16 19:07:06 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 411 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 16 19:07:06.448470 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-988b0cc7-f32c-4574-b2d2-f1a2870507dd tempest-VolumesSnapshotsTestJSON-2133080244 tempest-VolumesSnapshotsTestJSON-2133080244-project] Calling method '.version_select at 0x7f12e5b0c9d0>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:06.504404 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-988b0cc7-f32c-4574-b2d2-f1a2870507dd tempest-VolumesSnapshotsTestJSON-2133080244 tempest-VolumesSnapshotsTestJSON-2133080244-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/7c124cd3-a43d-4265-a06b-d52ac91e1b08" status: 200 len: 344 microversion: 2.1 time: 0.059930 Jun 16 19:07:06.505075 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 450/914] 10.222.0.70 () {58 vars in 1244 bytes} [Thu Jun 16 19:07:06 2022] GET /compute/v2.1/os-volumes/7c124cd3-a43d-4265-a06b-d52ac91e1b08 => generated 344 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:07:07.517980 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-f10c24c9-bd86-487a-9f46-407c3ebf6d47 tempest-VolumesSnapshotsTestJSON-2133080244 tempest-VolumesSnapshotsTestJSON-2133080244-project] Calling method '.version_select at 0x7f12e5f4bb80>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:07.565082 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-f10c24c9-bd86-487a-9f46-407c3ebf6d47 tempest-VolumesSnapshotsTestJSON-2133080244 tempest-VolumesSnapshotsTestJSON-2133080244-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/7c124cd3-a43d-4265-a06b-d52ac91e1b08" status: 200 len: 345 microversion: 2.1 time: 0.051991 Jun 16 19:07:07.565646 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 465/915] 10.222.0.70 () {58 vars in 1244 bytes} [Thu Jun 16 19:07:07 2022] GET /compute/v2.1/os-volumes/7c124cd3-a43d-4265-a06b-d52ac91e1b08 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:07:07.578259 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-8eb589a7-979e-46a1-9ad9-5b9b1cb54b2e tempest-VolumesSnapshotsTestJSON-2133080244 tempest-VolumesSnapshotsTestJSON-2133080244-project] Action: 'create', calling method: .version_select at 0x7f12e5ca51f0>, body: {"snapshot": {"volume_id": "7c124cd3-a43d-4265-a06b-d52ac91e1b08", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-434766018"}} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:07:07.733433 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-8eb589a7-979e-46a1-9ad9-5b9b1cb54b2e tempest-VolumesSnapshotsTestJSON-2133080244 tempest-VolumesSnapshotsTestJSON-2133080244-project] 10.222.0.70 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.160174 Jun 16 19:07:07.734106 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 451/916] 10.222.0.70 () {60 vars in 1161 bytes} [Thu Jun 16 19:07:07 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:07:07.744193 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-f7219e79-5cc1-4698-884e-f2d54240cd4b tempest-VolumesSnapshotsTestJSON-2133080244 tempest-VolumesSnapshotsTestJSON-2133080244-project] Calling method '.version_select at 0x7f12e5e8b160>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:07.775947 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-f7219e79-5cc1-4698-884e-f2d54240cd4b tempest-VolumesSnapshotsTestJSON-2133080244 tempest-VolumesSnapshotsTestJSON-2133080244-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/84c1ce67-b6bd-4f76-b7b0-b4a2057f5686" status: 200 len: 286 microversion: 2.1 time: 0.035526 Jun 16 19:07:07.776531 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 466/917] 10.222.0.70 () {58 vars in 1250 bytes} [Thu Jun 16 19:07:07 2022] GET /compute/v2.1/os-snapshots/84c1ce67-b6bd-4f76-b7b0-b4a2057f5686 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:07:07.788396 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-0bd315fa-0288-4ac4-af4d-962a36d8e1bf tempest-VolumesSnapshotsTestJSON-2133080244 tempest-VolumesSnapshotsTestJSON-2133080244-project] Calling method '.version_select at 0x7f12e5ca5af0>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:07.817639 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-0bd315fa-0288-4ac4-af4d-962a36d8e1bf tempest-VolumesSnapshotsTestJSON-2133080244 tempest-VolumesSnapshotsTestJSON-2133080244-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.033148 Jun 16 19:07:07.818334 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 452/918] 10.222.0.70 () {58 vars in 1139 bytes} [Thu Jun 16 19:07:07 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:07:07.828803 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-9b5f15ff-6e0e-44ea-ba3c-11fb83c73c4a tempest-VolumesSnapshotsTestJSON-2133080244 tempest-VolumesSnapshotsTestJSON-2133080244-project] Calling method '.version_select at 0x7f12e5e40700>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:07.859767 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-9b5f15ff-6e0e-44ea-ba3c-11fb83c73c4a tempest-VolumesSnapshotsTestJSON-2133080244 tempest-VolumesSnapshotsTestJSON-2133080244-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/84c1ce67-b6bd-4f76-b7b0-b4a2057f5686" status: 200 len: 286 microversion: 2.1 time: 0.034682 Jun 16 19:07:07.860327 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 467/919] 10.222.0.70 () {58 vars in 1250 bytes} [Thu Jun 16 19:07:07 2022] GET /compute/v2.1/os-snapshots/84c1ce67-b6bd-4f76-b7b0-b4a2057f5686 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:07:08.872131 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-22c3be07-b327-4d3a-9930-a401e7afcada tempest-VolumesSnapshotsTestJSON-2133080244 tempest-VolumesSnapshotsTestJSON-2133080244-project] Calling method '.version_select at 0x7f12e5e40790>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:08.901980 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-22c3be07-b327-4d3a-9930-a401e7afcada tempest-VolumesSnapshotsTestJSON-2133080244 tempest-VolumesSnapshotsTestJSON-2133080244-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/84c1ce67-b6bd-4f76-b7b0-b4a2057f5686" status: 200 len: 286 microversion: 2.1 time: 0.034136 Jun 16 19:07:08.902540 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 453/920] 10.222.0.70 () {58 vars in 1250 bytes} [Thu Jun 16 19:07:08 2022] GET /compute/v2.1/os-snapshots/84c1ce67-b6bd-4f76-b7b0-b4a2057f5686 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:07:09.913913 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-73aa9be8-fa57-4d37-b1f0-d3728e854ea4 tempest-VolumesSnapshotsTestJSON-2133080244 tempest-VolumesSnapshotsTestJSON-2133080244-project] Calling method '.version_select at 0x7f12e5dcb4c0>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:09.945127 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-73aa9be8-fa57-4d37-b1f0-d3728e854ea4 tempest-VolumesSnapshotsTestJSON-2133080244 tempest-VolumesSnapshotsTestJSON-2133080244-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/84c1ce67-b6bd-4f76-b7b0-b4a2057f5686" status: 200 len: 286 microversion: 2.1 time: 0.035581 Jun 16 19:07:09.945825 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 468/921] 10.222.0.70 () {58 vars in 1250 bytes} [Thu Jun 16 19:07:09 2022] GET /compute/v2.1/os-snapshots/84c1ce67-b6bd-4f76-b7b0-b4a2057f5686 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:07:10.958157 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-d3cfb0f1-9d40-4de3-92d0-dc8c2396f5ff tempest-VolumesSnapshotsTestJSON-2133080244 tempest-VolumesSnapshotsTestJSON-2133080244-project] Calling method '.version_select at 0x7f12e5f350d0>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:10.989670 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-d3cfb0f1-9d40-4de3-92d0-dc8c2396f5ff tempest-VolumesSnapshotsTestJSON-2133080244 tempest-VolumesSnapshotsTestJSON-2133080244-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/84c1ce67-b6bd-4f76-b7b0-b4a2057f5686" status: 200 len: 287 microversion: 2.1 time: 0.035873 Jun 16 19:07:10.990350 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 454/922] 10.222.0.70 () {58 vars in 1250 bytes} [Thu Jun 16 19:07:10 2022] GET /compute/v2.1/os-snapshots/84c1ce67-b6bd-4f76-b7b0-b4a2057f5686 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:07:11.001358 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-6adec098-c1ae-4b03-b91e-9223802f8d32 tempest-VolumesSnapshotsTestJSON-2133080244 tempest-VolumesSnapshotsTestJSON-2133080244-project] Calling method '.version_select at 0x7f12e5e72160>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:11.058549 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-6adec098-c1ae-4b03-b91e-9223802f8d32 tempest-VolumesSnapshotsTestJSON-2133080244 tempest-VolumesSnapshotsTestJSON-2133080244-project] 10.222.0.70 "DELETE /compute/v2.1/os-snapshots/84c1ce67-b6bd-4f76-b7b0-b4a2057f5686" status: 202 len: 0 microversion: 2.1 time: 0.061828 Jun 16 19:07:11.059151 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 469/923] 10.222.0.70 () {58 vars in 1253 bytes} [Thu Jun 16 19:07:10 2022] DELETE /compute/v2.1/os-snapshots/84c1ce67-b6bd-4f76-b7b0-b4a2057f5686 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:07:11.067694 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-8e632b4f-0aec-417e-8f6a-b62d82acae74 tempest-VolumesSnapshotsTestJSON-2133080244 tempest-VolumesSnapshotsTestJSON-2133080244-project] Calling method '.version_select at 0x7f12e5d52af0>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:11.098015 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-8e632b4f-0aec-417e-8f6a-b62d82acae74 tempest-VolumesSnapshotsTestJSON-2133080244 tempest-VolumesSnapshotsTestJSON-2133080244-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/84c1ce67-b6bd-4f76-b7b0-b4a2057f5686" status: 200 len: 286 microversion: 2.1 time: 0.034057 Jun 16 19:07:11.098599 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 455/924] 10.222.0.70 () {58 vars in 1250 bytes} [Thu Jun 16 19:07:11 2022] GET /compute/v2.1/os-snapshots/84c1ce67-b6bd-4f76-b7b0-b4a2057f5686 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:07:12.107751 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:07:12.108429 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:07:12.113065 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-b1452222-768c-43b4-9c8d-8fdd12859048 tempest-VolumesSnapshotsTestJSON-2133080244 tempest-VolumesSnapshotsTestJSON-2133080244-project] Calling method '.version_select at 0x7f12e5f4b700>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:12.138156 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.wsgi [None req-b1452222-768c-43b4-9c8d-8fdd12859048 tempest-VolumesSnapshotsTestJSON-2133080244 tempest-VolumesSnapshotsTestJSON-2133080244-project] HTTP exception thrown: Snapshot 84c1ce67-b6bd-4f76-b7b0-b4a2057f5686 could not be found. Jun 16 19:07:12.143476 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-b1452222-768c-43b4-9c8d-8fdd12859048 tempest-VolumesSnapshotsTestJSON-2133080244 tempest-VolumesSnapshotsTestJSON-2133080244-project] Request method failure captured: Jun 16 19:07:12.143476 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: request: GET /compute/v2.1/os-snapshots/84c1ce67-b6bd-4f76-b7b0-b4a2057f5686 HTTP/1.1 Jun 16 19:07:12.143476 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Accept: application/json Jun 16 19:07:12.143476 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Accept-Encoding: identity Jun 16 19:07:12.143476 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Connection: close Jun 16 19:07:12.143476 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Content-Length: 0 Jun 16 19:07:12.143476 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Content-Type: application/json Jun 16 19:07:12.143476 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Host: 10.222.0.70 Jun 16 19:07:12.143476 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Openstack-System-Scope: None Jun 16 19:07:12.143476 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: User-Agent: python-urllib3/1.26.9 Jun 16 19:07:12.143476 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Auth-Token: gAAAAABiq39ZCvO5f38imNCiouHAuZRlsLqWD-TRmbSTCxeVOs13VTi4UEc6mBln80NJQhcIF2yqJJ0XbVYr5imqq809ocpe4kaX077HN-QUu0d20I-pbmUZS3_1Z9l78O63KBXwnwqOfQsrcIm-Axry1pgSLEkrQcm4OYLMJya10VyUNe0bD38 Jun 16 19:07:12.143476 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Domain-Id: None Jun 16 19:07:12.143476 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Domain-Name: None Jun 16 19:07:12.143476 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Identity-Status: Confirmed Jun 16 19:07:12.143476 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Is-Admin-Project: True Jun 16 19:07:12.143476 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Domain-Id: default Jun 16 19:07:12.143476 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Domain-Name: Default Jun 16 19:07:12.143476 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Id: 53528b6015f2423db9e79f9090643158 Jun 16 19:07:12.143476 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2133080244 Jun 16 19:07:12.143476 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Role: member,reader Jun 16 19:07:12.143476 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Roles: member,reader Jun 16 19:07:12.145194 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/53528b6015f2423db9e79f9090643158"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_53528b6015f2423db9e79f9090643158", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/53528b6015f2423db9e79f9090643158"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/53528b6015f2423db9e79f9090643158"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 16 19:07:12.145194 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2133080244 Jun 16 19:07:12.145194 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant-Id: 53528b6015f2423db9e79f9090643158 Jun 16 19:07:12.145194 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2133080244 Jun 16 19:07:12.145194 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User: tempest-VolumesSnapshotsTestJSON-2133080244-project Jun 16 19:07:12.145194 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Domain-Id: default Jun 16 19:07:12.145194 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Domain-Name: Default Jun 16 19:07:12.145194 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Id: fd402a8feac24f43b1bb7a64fcca1683 Jun 16 19:07:12.145194 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2133080244-project Jun 16 19:07:12.145194 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: method: Jun 16 19:07:12.145194 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: exception: Snapshot 84c1ce67-b6bd-4f76-b7b0-b4a2057f5686 could not be found. Jun 16 19:07:12.145194 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: action_args: {'id': '84c1ce67-b6bd-4f76-b7b0-b4a2057f5686'} Jun 16 19:07:12.145194 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:07:12.146262 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:07:12.146262 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 16 19:07:12.146262 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 16 19:07:12.146262 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 16 19:07:12.146262 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 16 19:07:12.146262 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 16 19:07:12.146262 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 16 19:07:12.146262 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 19:07:12.146262 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 19:07:12.146262 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 19:07:12.146262 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 19:07:12.146262 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 19:07:12.146262 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 19:07:12.146262 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 19:07:12.146262 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 19:07:12.146262 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 84c1ce67-b6bd-4f76-b7b0-b4a2057f5686 could not be found. (HTTP 404) (Request-ID: req-2dca25c5-7398-45e4-9595-7578e9fec655) Jun 16 19:07:12.146262 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:07:12.146262 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:07:12.147796 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:07:12.147796 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:07:12.147796 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 16 19:07:12.147796 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 16 19:07:12.147796 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 19:07:12.147796 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 19:07:12.147796 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 16 19:07:12.147796 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 16 19:07:12.147796 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 19:07:12.147796 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 19:07:12.147796 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 16 19:07:12.147796 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 16 19:07:12.147796 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 16 19:07:12.147796 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 16 19:07:12.147796 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 16 19:07:12.147796 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 16 19:07:12.147796 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 19:07:12.147796 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 19:07:12.147796 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 19:07:12.149517 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 19:07:12.149517 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 19:07:12.149517 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 19:07:12.149517 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 19:07:12.149517 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 19:07:12.149517 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 84c1ce67-b6bd-4f76-b7b0-b4a2057f5686 could not be found. Jun 16 19:07:12.149517 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:07:12.149517 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:07:12.149517 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:07:12.149517 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:07:12.149517 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:07:12.149517 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:07:12.149517 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:07:12.149517 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:07:12.149517 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 19:07:12.149517 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 19:07:12.149517 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:07:12.149517 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:07:12.149517 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 16 19:07:12.149517 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:07:12.151069 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 84c1ce67-b6bd-4f76-b7b0-b4a2057f5686 could not be found. Jun 16 19:07:12.151069 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:07:12.151069 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:07:12.151069 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:07:12.151069 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:07:12.151069 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:07:12.151069 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:07:12.151069 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:07:12.151069 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:07:12.151069 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 84c1ce67-b6bd-4f76-b7b0-b4a2057f5686 could not be found. Jun 16 19:07:12.151069 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:07:12.151069 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-b1452222-768c-43b4-9c8d-8fdd12859048 tempest-VolumesSnapshotsTestJSON-2133080244 tempest-VolumesSnapshotsTestJSON-2133080244-project] Returning 404 to user: Snapshot 84c1ce67-b6bd-4f76-b7b0-b4a2057f5686 could not be found. {{(pid=117852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:07:12.151069 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-b1452222-768c-43b4-9c8d-8fdd12859048 tempest-VolumesSnapshotsTestJSON-2133080244 tempest-VolumesSnapshotsTestJSON-2133080244-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/84c1ce67-b6bd-4f76-b7b0-b4a2057f5686" status: 404 len: 111 microversion: 2.1 time: 0.038922 Jun 16 19:07:12.152148 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 470/925] 10.222.0.70 () {58 vars in 1250 bytes} [Thu Jun 16 19:07:12 2022] GET /compute/v2.1/os-snapshots/84c1ce67-b6bd-4f76-b7b0-b4a2057f5686 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:07:12.152275 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_api:SELECT=16,nova_api:DELETE=1 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:07:12.152275 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_cell1:SELECT=17 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:07:12.156996 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-04c0393e-c512-4ac1-b008-d8616adc517f tempest-VolumesSnapshotsTestJSON-2133080244 tempest-VolumesSnapshotsTestJSON-2133080244-project] Calling method '.version_select at 0x7f12e5b9e5e0>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:12.217021 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-04c0393e-c512-4ac1-b008-d8616adc517f tempest-VolumesSnapshotsTestJSON-2133080244 tempest-VolumesSnapshotsTestJSON-2133080244-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/7c124cd3-a43d-4265-a06b-d52ac91e1b08" status: 202 len: 0 microversion: 2.1 time: 0.065968 Jun 16 19:07:12.217380 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 456/926] 10.222.0.70 () {58 vars in 1247 bytes} [Thu Jun 16 19:07:12 2022] DELETE /compute/v2.1/os-volumes/7c124cd3-a43d-4265-a06b-d52ac91e1b08 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:07:12.225811 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-fa159697-7f95-47a0-b9db-f65c56357769 tempest-VolumesSnapshotsTestJSON-2133080244 tempest-VolumesSnapshotsTestJSON-2133080244-project] Calling method '.version_select at 0x7f12e5e40b80>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:12.276683 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-fa159697-7f95-47a0-b9db-f65c56357769 tempest-VolumesSnapshotsTestJSON-2133080244 tempest-VolumesSnapshotsTestJSON-2133080244-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/7c124cd3-a43d-4265-a06b-d52ac91e1b08" status: 200 len: 344 microversion: 2.1 time: 0.054609 Jun 16 19:07:12.277244 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 471/927] 10.222.0.70 () {58 vars in 1244 bytes} [Thu Jun 16 19:07:12 2022] GET /compute/v2.1/os-volumes/7c124cd3-a43d-4265-a06b-d52ac91e1b08 => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:07:13.290374 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-6f30f529-5d74-4dad-aa49-2fb4f944e23d tempest-VolumesSnapshotsTestJSON-2133080244 tempest-VolumesSnapshotsTestJSON-2133080244-project] Calling method '.version_select at 0x7f12e5f355e0>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:13.320246 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.wsgi [None req-6f30f529-5d74-4dad-aa49-2fb4f944e23d tempest-VolumesSnapshotsTestJSON-2133080244 tempest-VolumesSnapshotsTestJSON-2133080244-project] HTTP exception thrown: Volume 7c124cd3-a43d-4265-a06b-d52ac91e1b08 could not be found. Jun 16 19:07:13.322236 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-6f30f529-5d74-4dad-aa49-2fb4f944e23d tempest-VolumesSnapshotsTestJSON-2133080244 tempest-VolumesSnapshotsTestJSON-2133080244-project] Request method failure captured: Jun 16 19:07:13.322236 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: request: GET /compute/v2.1/os-volumes/7c124cd3-a43d-4265-a06b-d52ac91e1b08 HTTP/1.1 Jun 16 19:07:13.322236 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Accept: application/json Jun 16 19:07:13.322236 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Accept-Encoding: identity Jun 16 19:07:13.322236 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Connection: close Jun 16 19:07:13.322236 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Content-Length: 0 Jun 16 19:07:13.322236 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Content-Type: application/json Jun 16 19:07:13.322236 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Host: 10.222.0.70 Jun 16 19:07:13.322236 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Openstack-System-Scope: None Jun 16 19:07:13.322236 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: User-Agent: python-urllib3/1.26.9 Jun 16 19:07:13.322236 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Auth-Token: gAAAAABiq39ZCvO5f38imNCiouHAuZRlsLqWD-TRmbSTCxeVOs13VTi4UEc6mBln80NJQhcIF2yqJJ0XbVYr5imqq809ocpe4kaX077HN-QUu0d20I-pbmUZS3_1Z9l78O63KBXwnwqOfQsrcIm-Axry1pgSLEkrQcm4OYLMJya10VyUNe0bD38 Jun 16 19:07:13.322236 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Domain-Id: None Jun 16 19:07:13.322236 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Domain-Name: None Jun 16 19:07:13.322236 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Identity-Status: Confirmed Jun 16 19:07:13.322236 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Is-Admin-Project: True Jun 16 19:07:13.322236 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Domain-Id: default Jun 16 19:07:13.322236 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Domain-Name: Default Jun 16 19:07:13.322236 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Id: 53528b6015f2423db9e79f9090643158 Jun 16 19:07:13.322236 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2133080244 Jun 16 19:07:13.322236 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Role: member,reader Jun 16 19:07:13.322236 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Roles: member,reader Jun 16 19:07:13.324292 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/53528b6015f2423db9e79f9090643158"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_53528b6015f2423db9e79f9090643158", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/53528b6015f2423db9e79f9090643158"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/53528b6015f2423db9e79f9090643158"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 16 19:07:13.324292 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2133080244 Jun 16 19:07:13.324292 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant-Id: 53528b6015f2423db9e79f9090643158 Jun 16 19:07:13.324292 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2133080244 Jun 16 19:07:13.324292 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User: tempest-VolumesSnapshotsTestJSON-2133080244-project Jun 16 19:07:13.324292 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Domain-Id: default Jun 16 19:07:13.324292 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Domain-Name: Default Jun 16 19:07:13.324292 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Id: fd402a8feac24f43b1bb7a64fcca1683 Jun 16 19:07:13.324292 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2133080244-project Jun 16 19:07:13.324292 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: method: Jun 16 19:07:13.324292 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: exception: Volume 7c124cd3-a43d-4265-a06b-d52ac91e1b08 could not be found. Jun 16 19:07:13.324292 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: action_args: {'id': '7c124cd3-a43d-4265-a06b-d52ac91e1b08'} Jun 16 19:07:13.324292 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:07:13.326521 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:07:13.326521 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 19:07:13.326521 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 19:07:13.326521 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 19:07:13.326521 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 19:07:13.326521 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 19:07:13.326521 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 19:07:13.326521 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 19:07:13.326521 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 19:07:13.326521 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 19:07:13.326521 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 19:07:13.326521 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 19:07:13.326521 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 19:07:13.326521 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 19:07:13.326521 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 19:07:13.326521 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7c124cd3-a43d-4265-a06b-d52ac91e1b08 could not be found. (HTTP 404) (Request-ID: req-8187a68c-61b0-43a7-b1a5-9626893606a8) Jun 16 19:07:13.326521 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:07:13.326521 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:07:13.326521 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:07:13.329360 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:07:13.329360 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 19:07:13.329360 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 19:07:13.329360 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 19:07:13.329360 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 19:07:13.329360 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 19:07:13.329360 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 19:07:13.329360 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 19:07:13.329360 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 19:07:13.329360 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 19:07:13.329360 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 19:07:13.329360 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 19:07:13.329360 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 19:07:13.329360 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 19:07:13.329360 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 19:07:13.329360 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 19:07:13.329360 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 19:07:13.329360 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 19:07:13.329360 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 19:07:13.332163 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 19:07:13.332163 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 19:07:13.332163 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 19:07:13.332163 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 19:07:13.332163 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7c124cd3-a43d-4265-a06b-d52ac91e1b08 could not be found. Jun 16 19:07:13.332163 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:07:13.332163 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:07:13.332163 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:07:13.332163 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:07:13.332163 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:07:13.332163 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:07:13.332163 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:07:13.332163 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:07:13.332163 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 19:07:13.332163 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 19:07:13.332163 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:07:13.332163 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:07:13.332163 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 19:07:13.332163 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:07:13.334661 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7c124cd3-a43d-4265-a06b-d52ac91e1b08 could not be found. Jun 16 19:07:13.334661 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:07:13.334661 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:07:13.334661 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:07:13.334661 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:07:13.334661 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:07:13.334661 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:07:13.334661 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:07:13.334661 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:07:13.334661 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7c124cd3-a43d-4265-a06b-d52ac91e1b08 could not be found. Jun 16 19:07:13.334661 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:07:13.334661 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-6f30f529-5d74-4dad-aa49-2fb4f944e23d tempest-VolumesSnapshotsTestJSON-2133080244 tempest-VolumesSnapshotsTestJSON-2133080244-project] Returning 404 to user: Volume 7c124cd3-a43d-4265-a06b-d52ac91e1b08 could not be found. {{(pid=117850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:07:13.334661 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-6f30f529-5d74-4dad-aa49-2fb4f944e23d tempest-VolumesSnapshotsTestJSON-2133080244 tempest-VolumesSnapshotsTestJSON-2133080244-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/7c124cd3-a43d-4265-a06b-d52ac91e1b08" status: 404 len: 109 microversion: 2.1 time: 0.037804 Jun 16 19:07:13.334661 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 457/928] 10.222.0.70 () {58 vars in 1244 bytes} [Thu Jun 16 19:07:13 2022] GET /compute/v2.1/os-volumes/7c124cd3-a43d-4265-a06b-d52ac91e1b08 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:07:13.338022 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-22795c82-0300-4061-9b01-c2384d7e9f1f tempest-VolumesSnapshotsTestJSON-2133080244 tempest-VolumesSnapshotsTestJSON-2133080244-project] Calling method '.version_select at 0x7f12e5e40940>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:13.366317 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.wsgi [None req-22795c82-0300-4061-9b01-c2384d7e9f1f tempest-VolumesSnapshotsTestJSON-2133080244 tempest-VolumesSnapshotsTestJSON-2133080244-project] HTTP exception thrown: Volume 7c124cd3-a43d-4265-a06b-d52ac91e1b08 could not be found. Jun 16 19:07:13.368681 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-22795c82-0300-4061-9b01-c2384d7e9f1f tempest-VolumesSnapshotsTestJSON-2133080244 tempest-VolumesSnapshotsTestJSON-2133080244-project] Request method failure captured: Jun 16 19:07:13.368681 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: request: DELETE /compute/v2.1/os-volumes/7c124cd3-a43d-4265-a06b-d52ac91e1b08 HTTP/1.1 Jun 16 19:07:13.368681 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Accept: application/json Jun 16 19:07:13.368681 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Accept-Encoding: identity Jun 16 19:07:13.368681 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Connection: close Jun 16 19:07:13.368681 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Content-Length: 0 Jun 16 19:07:13.368681 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Content-Type: application/json Jun 16 19:07:13.368681 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Host: 10.222.0.70 Jun 16 19:07:13.368681 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Openstack-System-Scope: None Jun 16 19:07:13.368681 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: User-Agent: python-urllib3/1.26.9 Jun 16 19:07:13.368681 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Auth-Token: gAAAAABiq39ZCvO5f38imNCiouHAuZRlsLqWD-TRmbSTCxeVOs13VTi4UEc6mBln80NJQhcIF2yqJJ0XbVYr5imqq809ocpe4kaX077HN-QUu0d20I-pbmUZS3_1Z9l78O63KBXwnwqOfQsrcIm-Axry1pgSLEkrQcm4OYLMJya10VyUNe0bD38 Jun 16 19:07:13.368681 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Domain-Id: None Jun 16 19:07:13.368681 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Domain-Name: None Jun 16 19:07:13.368681 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Identity-Status: Confirmed Jun 16 19:07:13.368681 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Is-Admin-Project: True Jun 16 19:07:13.368681 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Domain-Id: default Jun 16 19:07:13.368681 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Domain-Name: Default Jun 16 19:07:13.368681 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Id: 53528b6015f2423db9e79f9090643158 Jun 16 19:07:13.368681 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2133080244 Jun 16 19:07:13.368681 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Role: member,reader Jun 16 19:07:13.368681 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Roles: member,reader Jun 16 19:07:13.370302 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/53528b6015f2423db9e79f9090643158"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_53528b6015f2423db9e79f9090643158", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/53528b6015f2423db9e79f9090643158"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/53528b6015f2423db9e79f9090643158"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 16 19:07:13.370302 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2133080244 Jun 16 19:07:13.370302 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant-Id: 53528b6015f2423db9e79f9090643158 Jun 16 19:07:13.370302 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2133080244 Jun 16 19:07:13.370302 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User: tempest-VolumesSnapshotsTestJSON-2133080244-project Jun 16 19:07:13.370302 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Domain-Id: default Jun 16 19:07:13.370302 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Domain-Name: Default Jun 16 19:07:13.370302 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Id: fd402a8feac24f43b1bb7a64fcca1683 Jun 16 19:07:13.370302 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2133080244-project Jun 16 19:07:13.370302 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: method: Jun 16 19:07:13.370302 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: exception: Volume 7c124cd3-a43d-4265-a06b-d52ac91e1b08 could not be found. Jun 16 19:07:13.370302 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: action_args: {'id': '7c124cd3-a43d-4265-a06b-d52ac91e1b08'} Jun 16 19:07:13.370302 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:07:13.371303 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:07:13.371303 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 19:07:13.371303 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 19:07:13.371303 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 19:07:13.371303 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 19:07:13.371303 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 19:07:13.371303 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 19:07:13.371303 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 19:07:13.371303 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 19:07:13.371303 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 19:07:13.371303 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 19:07:13.371303 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 19:07:13.371303 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 19:07:13.371303 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 19:07:13.371303 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 19:07:13.371303 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7c124cd3-a43d-4265-a06b-d52ac91e1b08 could not be found. (HTTP 404) (Request-ID: req-8d3cfeaa-426c-4a56-8d39-3a240a583e1b) Jun 16 19:07:13.371303 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:07:13.371303 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:07:13.371303 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:07:13.373496 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:07:13.373496 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 16 19:07:13.373496 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 16 19:07:13.373496 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 19:07:13.373496 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 19:07:13.373496 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 19:07:13.373496 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 19:07:13.373496 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 19:07:13.373496 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 19:07:13.373496 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 19:07:13.373496 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 19:07:13.373496 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 19:07:13.373496 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 19:07:13.373496 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 19:07:13.373496 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 19:07:13.373496 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 19:07:13.373496 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 19:07:13.373496 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 19:07:13.373496 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 19:07:13.375026 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 19:07:13.375026 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 19:07:13.375026 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 19:07:13.375026 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 19:07:13.375026 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7c124cd3-a43d-4265-a06b-d52ac91e1b08 could not be found. Jun 16 19:07:13.375026 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:07:13.375026 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:07:13.375026 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:07:13.375026 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:07:13.375026 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:07:13.375026 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:07:13.375026 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:07:13.375026 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:07:13.375026 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 19:07:13.375026 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 19:07:13.375026 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:07:13.375026 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:07:13.375026 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 16 19:07:13.375026 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:07:13.376543 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7c124cd3-a43d-4265-a06b-d52ac91e1b08 could not be found. Jun 16 19:07:13.376543 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:07:13.376543 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:07:13.376543 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:07:13.376543 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:07:13.376543 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:07:13.376543 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:07:13.376543 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:07:13.376543 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:07:13.376543 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7c124cd3-a43d-4265-a06b-d52ac91e1b08 could not be found. Jun 16 19:07:13.376543 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:07:13.376543 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-22795c82-0300-4061-9b01-c2384d7e9f1f tempest-VolumesSnapshotsTestJSON-2133080244 tempest-VolumesSnapshotsTestJSON-2133080244-project] Returning 404 to user: Volume 7c124cd3-a43d-4265-a06b-d52ac91e1b08 could not be found. {{(pid=117852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:07:13.376543 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-22795c82-0300-4061-9b01-c2384d7e9f1f tempest-VolumesSnapshotsTestJSON-2133080244 tempest-VolumesSnapshotsTestJSON-2133080244-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/7c124cd3-a43d-4265-a06b-d52ac91e1b08" status: 404 len: 109 microversion: 2.1 time: 0.038023 Jun 16 19:07:13.376543 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 472/929] 10.222.0.70 () {58 vars in 1247 bytes} [Thu Jun 16 19:07:13 2022] DELETE /compute/v2.1/os-volumes/7c124cd3-a43d-4265-a06b-d52ac91e1b08 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:07:13.379593 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-f0d703e6-fdb8-4c5d-aa23-0dddfb818a3c tempest-VolumesSnapshotsTestJSON-2133080244 tempest-VolumesSnapshotsTestJSON-2133080244-project] Calling method '.version_select at 0x7f12e5f35700>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:13.408280 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.wsgi [None req-f0d703e6-fdb8-4c5d-aa23-0dddfb818a3c tempest-VolumesSnapshotsTestJSON-2133080244 tempest-VolumesSnapshotsTestJSON-2133080244-project] HTTP exception thrown: Volume 7c124cd3-a43d-4265-a06b-d52ac91e1b08 could not be found. Jun 16 19:07:13.410295 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-f0d703e6-fdb8-4c5d-aa23-0dddfb818a3c tempest-VolumesSnapshotsTestJSON-2133080244 tempest-VolumesSnapshotsTestJSON-2133080244-project] Request method failure captured: Jun 16 19:07:13.410295 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: request: GET /compute/v2.1/os-volumes/7c124cd3-a43d-4265-a06b-d52ac91e1b08 HTTP/1.1 Jun 16 19:07:13.410295 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Accept: application/json Jun 16 19:07:13.410295 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Accept-Encoding: identity Jun 16 19:07:13.410295 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Connection: close Jun 16 19:07:13.410295 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Content-Length: 0 Jun 16 19:07:13.410295 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Content-Type: application/json Jun 16 19:07:13.410295 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Host: 10.222.0.70 Jun 16 19:07:13.410295 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Openstack-System-Scope: None Jun 16 19:07:13.410295 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: User-Agent: python-urllib3/1.26.9 Jun 16 19:07:13.410295 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Auth-Token: gAAAAABiq39ZCvO5f38imNCiouHAuZRlsLqWD-TRmbSTCxeVOs13VTi4UEc6mBln80NJQhcIF2yqJJ0XbVYr5imqq809ocpe4kaX077HN-QUu0d20I-pbmUZS3_1Z9l78O63KBXwnwqOfQsrcIm-Axry1pgSLEkrQcm4OYLMJya10VyUNe0bD38 Jun 16 19:07:13.410295 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Domain-Id: None Jun 16 19:07:13.410295 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Domain-Name: None Jun 16 19:07:13.410295 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Identity-Status: Confirmed Jun 16 19:07:13.410295 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Is-Admin-Project: True Jun 16 19:07:13.410295 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Domain-Id: default Jun 16 19:07:13.410295 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Domain-Name: Default Jun 16 19:07:13.410295 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Id: 53528b6015f2423db9e79f9090643158 Jun 16 19:07:13.410295 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2133080244 Jun 16 19:07:13.410295 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Role: member,reader Jun 16 19:07:13.410295 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Roles: member,reader Jun 16 19:07:13.411885 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/53528b6015f2423db9e79f9090643158"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_53528b6015f2423db9e79f9090643158", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/53528b6015f2423db9e79f9090643158"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/53528b6015f2423db9e79f9090643158"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 16 19:07:13.411885 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2133080244 Jun 16 19:07:13.411885 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant-Id: 53528b6015f2423db9e79f9090643158 Jun 16 19:07:13.411885 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2133080244 Jun 16 19:07:13.411885 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User: tempest-VolumesSnapshotsTestJSON-2133080244-project Jun 16 19:07:13.411885 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Domain-Id: default Jun 16 19:07:13.411885 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Domain-Name: Default Jun 16 19:07:13.411885 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Id: fd402a8feac24f43b1bb7a64fcca1683 Jun 16 19:07:13.411885 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2133080244-project Jun 16 19:07:13.411885 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: method: Jun 16 19:07:13.411885 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: exception: Volume 7c124cd3-a43d-4265-a06b-d52ac91e1b08 could not be found. Jun 16 19:07:13.411885 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: action_args: {'id': '7c124cd3-a43d-4265-a06b-d52ac91e1b08'} Jun 16 19:07:13.411885 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:07:13.412847 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:07:13.412847 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 19:07:13.412847 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 19:07:13.412847 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 19:07:13.412847 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 19:07:13.412847 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 19:07:13.412847 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 19:07:13.412847 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 19:07:13.412847 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 19:07:13.412847 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 19:07:13.412847 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 19:07:13.412847 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 19:07:13.412847 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 19:07:13.412847 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 19:07:13.412847 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 19:07:13.412847 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7c124cd3-a43d-4265-a06b-d52ac91e1b08 could not be found. (HTTP 404) (Request-ID: req-9beea748-10fe-417a-bbb4-b4f473d4a098) Jun 16 19:07:13.412847 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:07:13.412847 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:07:13.412847 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:07:13.414230 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:07:13.414230 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 19:07:13.414230 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 19:07:13.414230 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 19:07:13.414230 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 19:07:13.414230 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 19:07:13.414230 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 19:07:13.414230 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 19:07:13.414230 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 19:07:13.414230 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 19:07:13.414230 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 19:07:13.414230 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 19:07:13.414230 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 19:07:13.414230 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 19:07:13.414230 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 19:07:13.414230 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 19:07:13.414230 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 19:07:13.414230 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 19:07:13.414230 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 19:07:13.416109 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 19:07:13.416109 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 19:07:13.416109 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 19:07:13.416109 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 19:07:13.416109 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7c124cd3-a43d-4265-a06b-d52ac91e1b08 could not be found. Jun 16 19:07:13.416109 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:07:13.416109 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:07:13.416109 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:07:13.416109 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:07:13.416109 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:07:13.416109 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:07:13.416109 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:07:13.416109 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:07:13.416109 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 19:07:13.416109 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 19:07:13.416109 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:07:13.416109 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:07:13.416109 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 19:07:13.416109 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:07:13.417722 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7c124cd3-a43d-4265-a06b-d52ac91e1b08 could not be found. Jun 16 19:07:13.417722 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:07:13.417722 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:07:13.417722 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:07:13.417722 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:07:13.417722 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:07:13.417722 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:07:13.417722 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:07:13.417722 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:07:13.417722 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7c124cd3-a43d-4265-a06b-d52ac91e1b08 could not be found. Jun 16 19:07:13.417722 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:07:13.417722 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-f0d703e6-fdb8-4c5d-aa23-0dddfb818a3c tempest-VolumesSnapshotsTestJSON-2133080244 tempest-VolumesSnapshotsTestJSON-2133080244-project] Returning 404 to user: Volume 7c124cd3-a43d-4265-a06b-d52ac91e1b08 could not be found. {{(pid=117850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:07:13.417722 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-f0d703e6-fdb8-4c5d-aa23-0dddfb818a3c tempest-VolumesSnapshotsTestJSON-2133080244 tempest-VolumesSnapshotsTestJSON-2133080244-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/7c124cd3-a43d-4265-a06b-d52ac91e1b08" status: 404 len: 109 microversion: 2.1 time: 0.037427 Jun 16 19:07:13.417722 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 458/930] 10.222.0.70 () {58 vars in 1244 bytes} [Thu Jun 16 19:07:13 2022] GET /compute/v2.1/os-volumes/7c124cd3-a43d-4265-a06b-d52ac91e1b08 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:07:14.834795 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-0b76407e-d4ea-4275-92cc-3e9e5756dbed tempest-VolumesNegativeTest-2007710109 tempest-VolumesNegativeTest-2007710109-project] Action: 'create', calling method: .version_select at 0x7f12e5e40670>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1167693255", "metadata": {"Type": "work"}}} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:07:14.861323 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-0b76407e-d4ea-4275-92cc-3e9e5756dbed tempest-VolumesNegativeTest-2007710109 tempest-VolumesNegativeTest-2007710109-project] Request method failure captured: Jun 16 19:07:14.861323 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 16 19:07:14.861323 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Accept: application/json Jun 16 19:07:14.861323 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Accept-Encoding: identity Jun 16 19:07:14.861323 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Connection: close Jun 16 19:07:14.861323 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Content-Length: 122 Jun 16 19:07:14.861323 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Content-Type: application/json Jun 16 19:07:14.861323 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Host: 10.222.0.70 Jun 16 19:07:14.861323 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Openstack-System-Scope: None Jun 16 19:07:14.861323 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: User-Agent: python-urllib3/1.26.9 Jun 16 19:07:14.861323 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Auth-Token: gAAAAABiq39iwdAzB9jirRJ9nS8GQGRNqGu_eQimcGjWMnXLZukjB59crJmMgM0X1UgGGIC0JH5H8w_E_PtongUUbxk3Gd6b-vMAH8NDcU7c0JhonPLfGxxU8Nc8BFYX6wi806-7HElrN00ow9Bxnasd2sCgsrirY4yHE56r4zPtBVkMDTJypEI Jun 16 19:07:14.861323 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Domain-Id: None Jun 16 19:07:14.861323 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Domain-Name: None Jun 16 19:07:14.861323 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Identity-Status: Confirmed Jun 16 19:07:14.861323 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Is-Admin-Project: True Jun 16 19:07:14.861323 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Domain-Id: default Jun 16 19:07:14.861323 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Domain-Name: Default Jun 16 19:07:14.861323 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Id: ddd0d6cc6ac0450fb85d4141fb62f4d5 Jun 16 19:07:14.861323 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Name: tempest-VolumesNegativeTest-2007710109 Jun 16 19:07:14.861323 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Role: member,reader Jun 16 19:07:14.861323 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Roles: member,reader Jun 16 19:07:14.862995 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ddd0d6cc6ac0450fb85d4141fb62f4d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_ddd0d6cc6ac0450fb85d4141fb62f4d5", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/ddd0d6cc6ac0450fb85d4141fb62f4d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ddd0d6cc6ac0450fb85d4141fb62f4d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 16 19:07:14.862995 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant: tempest-VolumesNegativeTest-2007710109 Jun 16 19:07:14.862995 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant-Id: ddd0d6cc6ac0450fb85d4141fb62f4d5 Jun 16 19:07:14.862995 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant-Name: tempest-VolumesNegativeTest-2007710109 Jun 16 19:07:14.862995 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User: tempest-VolumesNegativeTest-2007710109-project Jun 16 19:07:14.862995 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Domain-Id: default Jun 16 19:07:14.862995 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Domain-Name: Default Jun 16 19:07:14.862995 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Id: 7b6aeacd0c574098827be19ad11534fc Jun 16 19:07:14.862995 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Name: tempest-VolumesNegativeTest-2007710109-project Jun 16 19:07:14.862995 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Jun 16 19:07:14.862995 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1167693255", "metadata": {"Type": "work"}}} Jun 16 19:07:14.862995 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: method: Jun 16 19:07:14.862995 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 16 19:07:14.864109 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1167693255', 'metadata': {'Type': 'work'}}}} Jun 16 19:07:14.864109 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:07:14.864109 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:07:14.864109 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 19:07:14.864109 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 19:07:14.864109 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 19:07:14.864109 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise error Jun 16 19:07:14.864109 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 16 19:07:14.864109 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:07:14.864109 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 16 19:07:14.864109 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 16 19:07:14.864109 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:07:14.864109 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 16 19:07:14.864109 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi '#$%' Jun 16 19:07:14.864109 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:07:14.864109 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:07:14.864109 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:07:14.864109 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:07:14.864109 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:07:14.864109 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:07:14.864109 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:07:14.864109 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:07:14.865593 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 19:07:14.865593 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 19:07:14.865593 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:07:14.865593 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:07:14.865593 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 19:07:14.865593 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 19:07:14.865593 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 19:07:14.865593 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 19:07:14.865593 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 19:07:14.865593 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 19:07:14.865593 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 16 19:07:14.865593 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:07:14.865593 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:07:14.865593 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:07:14.865593 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:07:14.865593 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:07:14.865593 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:07:14.865593 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 19:07:14.865593 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 19:07:14.866819 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 16 19:07:14.866819 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:07:14.866819 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-0b76407e-d4ea-4275-92cc-3e9e5756dbed tempest-VolumesNegativeTest-2007710109 tempest-VolumesNegativeTest-2007710109-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:07:14.866819 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-0b76407e-d4ea-4275-92cc-3e9e5756dbed tempest-VolumesNegativeTest-2007710109 tempest-VolumesNegativeTest-2007710109-project] 10.222.0.70 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.154083 Jun 16 19:07:14.866819 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 473/931] 10.222.0.70 () {60 vars in 1155 bytes} [Thu Jun 16 19:07:14 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 155 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 19:07:14.874648 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-b12f8d43-62c2-4587-95a3-515fe97e157c tempest-VolumesNegativeTest-2007710109 tempest-VolumesNegativeTest-2007710109-project] Action: 'create', calling method: .version_select at 0x7f12e5cf7e50>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2131223652", "metadata": {"Type": "work"}}} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:07:14.877882 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-b12f8d43-62c2-4587-95a3-515fe97e157c tempest-VolumesNegativeTest-2007710109 tempest-VolumesNegativeTest-2007710109-project] Request method failure captured: Jun 16 19:07:14.877882 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 16 19:07:14.877882 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Accept: application/json Jun 16 19:07:14.877882 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Accept-Encoding: identity Jun 16 19:07:14.877882 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Connection: close Jun 16 19:07:14.877882 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Content-Length: 120 Jun 16 19:07:14.877882 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Content-Type: application/json Jun 16 19:07:14.877882 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Host: 10.222.0.70 Jun 16 19:07:14.877882 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Openstack-System-Scope: None Jun 16 19:07:14.877882 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: User-Agent: python-urllib3/1.26.9 Jun 16 19:07:14.877882 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Auth-Token: gAAAAABiq39iwdAzB9jirRJ9nS8GQGRNqGu_eQimcGjWMnXLZukjB59crJmMgM0X1UgGGIC0JH5H8w_E_PtongUUbxk3Gd6b-vMAH8NDcU7c0JhonPLfGxxU8Nc8BFYX6wi806-7HElrN00ow9Bxnasd2sCgsrirY4yHE56r4zPtBVkMDTJypEI Jun 16 19:07:14.877882 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Domain-Id: None Jun 16 19:07:14.877882 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Domain-Name: None Jun 16 19:07:14.877882 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Identity-Status: Confirmed Jun 16 19:07:14.877882 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Is-Admin-Project: True Jun 16 19:07:14.877882 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Domain-Id: default Jun 16 19:07:14.877882 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Domain-Name: Default Jun 16 19:07:14.877882 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Id: ddd0d6cc6ac0450fb85d4141fb62f4d5 Jun 16 19:07:14.877882 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Name: tempest-VolumesNegativeTest-2007710109 Jun 16 19:07:14.877882 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Role: member,reader Jun 16 19:07:14.877882 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Roles: member,reader Jun 16 19:07:14.879356 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ddd0d6cc6ac0450fb85d4141fb62f4d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_ddd0d6cc6ac0450fb85d4141fb62f4d5", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/ddd0d6cc6ac0450fb85d4141fb62f4d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ddd0d6cc6ac0450fb85d4141fb62f4d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 16 19:07:14.879356 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant: tempest-VolumesNegativeTest-2007710109 Jun 16 19:07:14.879356 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant-Id: ddd0d6cc6ac0450fb85d4141fb62f4d5 Jun 16 19:07:14.879356 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant-Name: tempest-VolumesNegativeTest-2007710109 Jun 16 19:07:14.879356 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User: tempest-VolumesNegativeTest-2007710109-project Jun 16 19:07:14.879356 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Domain-Id: default Jun 16 19:07:14.879356 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Domain-Name: Default Jun 16 19:07:14.879356 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Id: 7b6aeacd0c574098827be19ad11534fc Jun 16 19:07:14.879356 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Name: tempest-VolumesNegativeTest-2007710109-project Jun 16 19:07:14.879356 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Jun 16 19:07:14.879356 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2131223652", "metadata": {"Type": "work"}}} Jun 16 19:07:14.879356 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: method: Jun 16 19:07:14.879356 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 16 19:07:14.880194 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2131223652', 'metadata': {'Type': 'work'}}}} Jun 16 19:07:14.880194 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:07:14.880194 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:07:14.880194 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 19:07:14.880194 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 19:07:14.880194 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 19:07:14.880194 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise error Jun 16 19:07:14.880194 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 16 19:07:14.880194 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:07:14.880194 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 16 19:07:14.880194 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 16 19:07:14.880194 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:07:14.880194 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 16 19:07:14.880194 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi '0' Jun 16 19:07:14.880194 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:07:14.880194 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:07:14.880194 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:07:14.880194 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:07:14.880194 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:07:14.880194 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:07:14.880194 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:07:14.880194 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:07:14.881610 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 19:07:14.881610 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 19:07:14.881610 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:07:14.881610 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:07:14.881610 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 19:07:14.881610 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 19:07:14.881610 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 19:07:14.881610 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 19:07:14.881610 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 19:07:14.881610 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 19:07:14.881610 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 16 19:07:14.881610 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:07:14.881610 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:07:14.881610 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:07:14.881610 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:07:14.881610 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:07:14.881610 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:07:14.881610 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 19:07:14.881610 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 19:07:14.884080 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 16 19:07:14.884080 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:07:14.884080 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-b12f8d43-62c2-4587-95a3-515fe97e157c tempest-VolumesNegativeTest-2007710109 tempest-VolumesNegativeTest-2007710109-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:07:14.884080 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-b12f8d43-62c2-4587-95a3-515fe97e157c tempest-VolumesNegativeTest-2007710109 tempest-VolumesNegativeTest-2007710109-project] 10.222.0.70 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010505 Jun 16 19:07:14.884080 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 459/932] 10.222.0.70 () {60 vars in 1155 bytes} [Thu Jun 16 19:07:14 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 19:07:14.889967 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-27deaed8-91ee-47b5-bb89-f0c92e7393f4 tempest-VolumesNegativeTest-2007710109 tempest-VolumesNegativeTest-2007710109-project] Action: 'create', calling method: .version_select at 0x7f12e5eacca0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1129896043", "metadata": {"Type": "work"}}} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:07:14.892287 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-27deaed8-91ee-47b5-bb89-f0c92e7393f4 tempest-VolumesNegativeTest-2007710109 tempest-VolumesNegativeTest-2007710109-project] Request method failure captured: Jun 16 19:07:14.892287 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 16 19:07:14.892287 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Accept: application/json Jun 16 19:07:14.892287 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Accept-Encoding: identity Jun 16 19:07:14.892287 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Connection: close Jun 16 19:07:14.892287 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Content-Length: 119 Jun 16 19:07:14.892287 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Content-Type: application/json Jun 16 19:07:14.892287 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Host: 10.222.0.70 Jun 16 19:07:14.892287 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Openstack-System-Scope: None Jun 16 19:07:14.892287 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: User-Agent: python-urllib3/1.26.9 Jun 16 19:07:14.892287 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Auth-Token: gAAAAABiq39iwdAzB9jirRJ9nS8GQGRNqGu_eQimcGjWMnXLZukjB59crJmMgM0X1UgGGIC0JH5H8w_E_PtongUUbxk3Gd6b-vMAH8NDcU7c0JhonPLfGxxU8Nc8BFYX6wi806-7HElrN00ow9Bxnasd2sCgsrirY4yHE56r4zPtBVkMDTJypEI Jun 16 19:07:14.892287 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Domain-Id: None Jun 16 19:07:14.892287 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Domain-Name: None Jun 16 19:07:14.892287 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Identity-Status: Confirmed Jun 16 19:07:14.892287 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Is-Admin-Project: True Jun 16 19:07:14.892287 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Domain-Id: default Jun 16 19:07:14.892287 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Domain-Name: Default Jun 16 19:07:14.892287 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Id: ddd0d6cc6ac0450fb85d4141fb62f4d5 Jun 16 19:07:14.892287 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Name: tempest-VolumesNegativeTest-2007710109 Jun 16 19:07:14.892287 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Role: member,reader Jun 16 19:07:14.892287 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Roles: member,reader Jun 16 19:07:14.893973 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ddd0d6cc6ac0450fb85d4141fb62f4d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_ddd0d6cc6ac0450fb85d4141fb62f4d5", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/ddd0d6cc6ac0450fb85d4141fb62f4d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ddd0d6cc6ac0450fb85d4141fb62f4d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 16 19:07:14.893973 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant: tempest-VolumesNegativeTest-2007710109 Jun 16 19:07:14.893973 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant-Id: ddd0d6cc6ac0450fb85d4141fb62f4d5 Jun 16 19:07:14.893973 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant-Name: tempest-VolumesNegativeTest-2007710109 Jun 16 19:07:14.893973 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User: tempest-VolumesNegativeTest-2007710109-project Jun 16 19:07:14.893973 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Domain-Id: default Jun 16 19:07:14.893973 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Domain-Name: Default Jun 16 19:07:14.893973 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Id: 7b6aeacd0c574098827be19ad11534fc Jun 16 19:07:14.893973 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Name: tempest-VolumesNegativeTest-2007710109-project Jun 16 19:07:14.893973 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Jun 16 19:07:14.893973 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1129896043", "metadata": {"Type": "work"}}} Jun 16 19:07:14.893973 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: method: Jun 16 19:07:14.893973 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 16 19:07:14.895004 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1129896043', 'metadata': {'Type': 'work'}}}} Jun 16 19:07:14.895004 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:07:14.895004 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:07:14.895004 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 19:07:14.895004 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 19:07:14.895004 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 19:07:14.895004 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise error Jun 16 19:07:14.895004 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 16 19:07:14.895004 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:07:14.895004 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 16 19:07:14.895004 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 16 19:07:14.895004 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:07:14.895004 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 16 19:07:14.895004 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi '' Jun 16 19:07:14.895004 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:07:14.895004 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:07:14.895004 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:07:14.895004 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:07:14.895004 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:07:14.895004 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:07:14.895004 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:07:14.895004 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:07:14.896597 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 19:07:14.896597 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 19:07:14.896597 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:07:14.896597 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:07:14.896597 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 19:07:14.896597 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 19:07:14.896597 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 19:07:14.896597 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 19:07:14.896597 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 19:07:14.896597 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 19:07:14.896597 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 16 19:07:14.896597 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:07:14.896597 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:07:14.896597 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:07:14.896597 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:07:14.896597 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:07:14.896597 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:07:14.896597 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 19:07:14.896597 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 19:07:14.897984 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 16 19:07:14.897984 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:07:14.897984 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-27deaed8-91ee-47b5-bb89-f0c92e7393f4 tempest-VolumesNegativeTest-2007710109 tempest-VolumesNegativeTest-2007710109-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:07:14.897984 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-27deaed8-91ee-47b5-bb89-f0c92e7393f4 tempest-VolumesNegativeTest-2007710109 tempest-VolumesNegativeTest-2007710109-project] 10.222.0.70 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008016 Jun 16 19:07:14.897984 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 474/933] 10.222.0.70 () {60 vars in 1155 bytes} [Thu Jun 16 19:07:14 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 19:07:14.903580 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-4f8567a9-468d-4c61-ace5-bc5b8e295daa tempest-VolumesNegativeTest-2007710109 tempest-VolumesNegativeTest-2007710109-project] Calling method '.version_select at 0x7f12e5f10700>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:14.931684 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.wsgi [None req-4f8567a9-468d-4c61-ace5-bc5b8e295daa tempest-VolumesNegativeTest-2007710109 tempest-VolumesNegativeTest-2007710109-project] HTTP exception thrown: Volume tempest-invalid-425437362 could not be found. Jun 16 19:07:14.933622 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-4f8567a9-468d-4c61-ace5-bc5b8e295daa tempest-VolumesNegativeTest-2007710109 tempest-VolumesNegativeTest-2007710109-project] Request method failure captured: Jun 16 19:07:14.933622 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-425437362 HTTP/1.1 Jun 16 19:07:14.933622 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Accept: application/json Jun 16 19:07:14.933622 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Accept-Encoding: identity Jun 16 19:07:14.933622 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Connection: close Jun 16 19:07:14.933622 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Content-Length: 0 Jun 16 19:07:14.933622 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Content-Type: application/json Jun 16 19:07:14.933622 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Host: 10.222.0.70 Jun 16 19:07:14.933622 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Openstack-System-Scope: None Jun 16 19:07:14.933622 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: User-Agent: python-urllib3/1.26.9 Jun 16 19:07:14.933622 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Auth-Token: gAAAAABiq39iwdAzB9jirRJ9nS8GQGRNqGu_eQimcGjWMnXLZukjB59crJmMgM0X1UgGGIC0JH5H8w_E_PtongUUbxk3Gd6b-vMAH8NDcU7c0JhonPLfGxxU8Nc8BFYX6wi806-7HElrN00ow9Bxnasd2sCgsrirY4yHE56r4zPtBVkMDTJypEI Jun 16 19:07:14.933622 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Domain-Id: None Jun 16 19:07:14.933622 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Domain-Name: None Jun 16 19:07:14.933622 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Identity-Status: Confirmed Jun 16 19:07:14.933622 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Is-Admin-Project: True Jun 16 19:07:14.933622 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Domain-Id: default Jun 16 19:07:14.933622 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Domain-Name: Default Jun 16 19:07:14.933622 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Id: ddd0d6cc6ac0450fb85d4141fb62f4d5 Jun 16 19:07:14.933622 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Name: tempest-VolumesNegativeTest-2007710109 Jun 16 19:07:14.933622 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Role: member,reader Jun 16 19:07:14.933622 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Roles: member,reader Jun 16 19:07:14.936029 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ddd0d6cc6ac0450fb85d4141fb62f4d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_ddd0d6cc6ac0450fb85d4141fb62f4d5", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/ddd0d6cc6ac0450fb85d4141fb62f4d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ddd0d6cc6ac0450fb85d4141fb62f4d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 16 19:07:14.936029 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant: tempest-VolumesNegativeTest-2007710109 Jun 16 19:07:14.936029 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant-Id: ddd0d6cc6ac0450fb85d4141fb62f4d5 Jun 16 19:07:14.936029 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant-Name: tempest-VolumesNegativeTest-2007710109 Jun 16 19:07:14.936029 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User: tempest-VolumesNegativeTest-2007710109-project Jun 16 19:07:14.936029 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Domain-Id: default Jun 16 19:07:14.936029 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Domain-Name: Default Jun 16 19:07:14.936029 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Id: 7b6aeacd0c574098827be19ad11534fc Jun 16 19:07:14.936029 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Name: tempest-VolumesNegativeTest-2007710109-project Jun 16 19:07:14.936029 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: method: Jun 16 19:07:14.936029 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: exception: Volume tempest-invalid-425437362 could not be found. Jun 16 19:07:14.936029 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: action_args: {'id': 'tempest-invalid-425437362'} Jun 16 19:07:14.936029 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:07:14.941160 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:07:14.941160 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 19:07:14.941160 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 19:07:14.941160 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 19:07:14.941160 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 19:07:14.941160 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 19:07:14.941160 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 19:07:14.941160 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 19:07:14.941160 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 19:07:14.941160 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 19:07:14.941160 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 19:07:14.941160 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 19:07:14.941160 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 19:07:14.941160 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 19:07:14.941160 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 19:07:14.941160 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-425437362 could not be found. (HTTP 404) (Request-ID: req-68c2b8e4-0e91-4c79-9cf7-66cf8fb13f5d) Jun 16 19:07:14.941160 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:07:14.941160 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:07:14.941160 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:07:14.942461 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:07:14.942461 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 16 19:07:14.942461 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 16 19:07:14.942461 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 19:07:14.942461 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 19:07:14.942461 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 19:07:14.942461 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 19:07:14.942461 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 19:07:14.942461 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 19:07:14.942461 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 19:07:14.942461 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 19:07:14.942461 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 19:07:14.942461 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 19:07:14.942461 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 19:07:14.942461 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 19:07:14.942461 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 19:07:14.942461 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 19:07:14.942461 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 19:07:14.942461 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 19:07:14.943939 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 19:07:14.943939 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 19:07:14.943939 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 19:07:14.943939 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 19:07:14.943939 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-425437362 could not be found. Jun 16 19:07:14.943939 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:07:14.943939 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:07:14.943939 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:07:14.943939 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:07:14.943939 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:07:14.943939 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:07:14.943939 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:07:14.943939 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:07:14.943939 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 19:07:14.943939 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 19:07:14.943939 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:07:14.943939 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:07:14.943939 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 16 19:07:14.943939 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:07:14.943939 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-425437362 could not be found. Jun 16 19:07:14.950123 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:07:14.950123 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:07:14.950123 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:07:14.950123 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:07:14.950123 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:07:14.950123 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:07:14.950123 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:07:14.950123 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:07:14.950123 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-425437362 could not be found. Jun 16 19:07:14.950123 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:07:14.950123 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-4f8567a9-468d-4c61-ace5-bc5b8e295daa tempest-VolumesNegativeTest-2007710109 tempest-VolumesNegativeTest-2007710109-project] Returning 404 to user: Volume tempest-invalid-425437362 could not be found. {{(pid=117850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:07:14.950123 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-4f8567a9-468d-4c61-ace5-bc5b8e295daa tempest-VolumesNegativeTest-2007710109 tempest-VolumesNegativeTest-2007710109-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/tempest-invalid-425437362" status: 404 len: 98 microversion: 2.1 time: 0.035413 Jun 16 19:07:14.950123 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 460/934] 10.222.0.70 () {58 vars in 1214 bytes} [Thu Jun 16 19:07:14 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-425437362 => generated 98 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 19:07:14.951272 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-805e3aaf-cd8b-4791-8d7d-e4d06246c13f tempest-VolumesNegativeTest-2007710109 tempest-VolumesNegativeTest-2007710109-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006007 Jun 16 19:07:14.951272 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 475/935] 10.222.0.70 () {58 vars in 1139 bytes} [Thu Jun 16 19:07:14 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 16 19:07:14.959976 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-0a4a1a91-9a78-487f-929c-0bc1d09dcd91 tempest-VolumesNegativeTest-2007710109 tempest-VolumesNegativeTest-2007710109-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005002 Jun 16 19:07:14.960473 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 461/936] 10.222.0.70 () {58 vars in 1136 bytes} [Thu Jun 16 19:07:14 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 16 19:07:14.970245 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-1935d213-47df-4f08-9d35-b9d3c2e91c8e tempest-VolumesNegativeTest-2007710109 tempest-VolumesNegativeTest-2007710109-project] Calling method '.version_select at 0x7f12e5eac3a0>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:14.999159 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.wsgi [None req-1935d213-47df-4f08-9d35-b9d3c2e91c8e tempest-VolumesNegativeTest-2007710109 tempest-VolumesNegativeTest-2007710109-project] HTTP exception thrown: Volume 205b0415-21f8-409d-817b-b3f15e27097b could not be found. Jun 16 19:07:15.001137 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-1935d213-47df-4f08-9d35-b9d3c2e91c8e tempest-VolumesNegativeTest-2007710109 tempest-VolumesNegativeTest-2007710109-project] Request method failure captured: Jun 16 19:07:15.001137 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: request: DELETE /compute/v2.1/os-volumes/205b0415-21f8-409d-817b-b3f15e27097b HTTP/1.1 Jun 16 19:07:15.001137 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Accept: application/json Jun 16 19:07:15.001137 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Accept-Encoding: identity Jun 16 19:07:15.001137 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Connection: close Jun 16 19:07:15.001137 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Content-Length: 0 Jun 16 19:07:15.001137 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Content-Type: application/json Jun 16 19:07:15.001137 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Host: 10.222.0.70 Jun 16 19:07:15.001137 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Openstack-System-Scope: None Jun 16 19:07:15.001137 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: User-Agent: python-urllib3/1.26.9 Jun 16 19:07:15.001137 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Auth-Token: gAAAAABiq39iwdAzB9jirRJ9nS8GQGRNqGu_eQimcGjWMnXLZukjB59crJmMgM0X1UgGGIC0JH5H8w_E_PtongUUbxk3Gd6b-vMAH8NDcU7c0JhonPLfGxxU8Nc8BFYX6wi806-7HElrN00ow9Bxnasd2sCgsrirY4yHE56r4zPtBVkMDTJypEI Jun 16 19:07:15.001137 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Domain-Id: None Jun 16 19:07:15.001137 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Domain-Name: None Jun 16 19:07:15.001137 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Identity-Status: Confirmed Jun 16 19:07:15.001137 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Is-Admin-Project: True Jun 16 19:07:15.001137 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Domain-Id: default Jun 16 19:07:15.001137 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Domain-Name: Default Jun 16 19:07:15.001137 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Id: ddd0d6cc6ac0450fb85d4141fb62f4d5 Jun 16 19:07:15.001137 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Name: tempest-VolumesNegativeTest-2007710109 Jun 16 19:07:15.001137 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Role: member,reader Jun 16 19:07:15.001137 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Roles: member,reader Jun 16 19:07:15.002759 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ddd0d6cc6ac0450fb85d4141fb62f4d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_ddd0d6cc6ac0450fb85d4141fb62f4d5", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/ddd0d6cc6ac0450fb85d4141fb62f4d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ddd0d6cc6ac0450fb85d4141fb62f4d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 16 19:07:15.002759 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant: tempest-VolumesNegativeTest-2007710109 Jun 16 19:07:15.002759 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant-Id: ddd0d6cc6ac0450fb85d4141fb62f4d5 Jun 16 19:07:15.002759 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant-Name: tempest-VolumesNegativeTest-2007710109 Jun 16 19:07:15.002759 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User: tempest-VolumesNegativeTest-2007710109-project Jun 16 19:07:15.002759 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Domain-Id: default Jun 16 19:07:15.002759 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Domain-Name: Default Jun 16 19:07:15.002759 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Id: 7b6aeacd0c574098827be19ad11534fc Jun 16 19:07:15.002759 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Name: tempest-VolumesNegativeTest-2007710109-project Jun 16 19:07:15.002759 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: method: Jun 16 19:07:15.002759 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: exception: Volume 205b0415-21f8-409d-817b-b3f15e27097b could not be found. Jun 16 19:07:15.002759 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: action_args: {'id': '205b0415-21f8-409d-817b-b3f15e27097b'} Jun 16 19:07:15.002759 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:07:15.003709 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:07:15.003709 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 19:07:15.003709 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 19:07:15.003709 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 19:07:15.003709 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 19:07:15.003709 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 19:07:15.003709 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 19:07:15.003709 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 19:07:15.003709 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 19:07:15.003709 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 19:07:15.003709 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 19:07:15.003709 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 19:07:15.003709 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 19:07:15.003709 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 19:07:15.003709 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 19:07:15.003709 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 205b0415-21f8-409d-817b-b3f15e27097b could not be found. (HTTP 404) (Request-ID: req-c698b27d-2221-4f9f-8601-20726a242792) Jun 16 19:07:15.003709 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:07:15.003709 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:07:15.003709 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:07:15.005570 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:07:15.005570 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 16 19:07:15.005570 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 16 19:07:15.005570 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 19:07:15.005570 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 19:07:15.005570 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 19:07:15.005570 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 19:07:15.005570 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 19:07:15.005570 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 19:07:15.005570 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 19:07:15.005570 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 19:07:15.005570 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 19:07:15.005570 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 19:07:15.005570 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 19:07:15.005570 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 19:07:15.005570 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 19:07:15.005570 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 19:07:15.005570 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 19:07:15.005570 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 19:07:15.007057 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 19:07:15.007057 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 19:07:15.007057 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 19:07:15.007057 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 19:07:15.007057 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 205b0415-21f8-409d-817b-b3f15e27097b could not be found. Jun 16 19:07:15.007057 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:07:15.007057 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:07:15.007057 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:07:15.007057 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:07:15.007057 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:07:15.007057 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:07:15.007057 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:07:15.007057 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:07:15.007057 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 19:07:15.007057 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 19:07:15.007057 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:07:15.007057 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:07:15.007057 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 16 19:07:15.007057 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:07:15.008574 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 205b0415-21f8-409d-817b-b3f15e27097b could not be found. Jun 16 19:07:15.008574 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:07:15.008574 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:07:15.008574 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:07:15.008574 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:07:15.008574 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:07:15.008574 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:07:15.008574 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:07:15.008574 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:07:15.008574 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 205b0415-21f8-409d-817b-b3f15e27097b could not be found. Jun 16 19:07:15.008574 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:07:15.008574 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-1935d213-47df-4f08-9d35-b9d3c2e91c8e tempest-VolumesNegativeTest-2007710109 tempest-VolumesNegativeTest-2007710109-project] Returning 404 to user: Volume 205b0415-21f8-409d-817b-b3f15e27097b could not be found. {{(pid=117852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:07:15.008574 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-1935d213-47df-4f08-9d35-b9d3c2e91c8e tempest-VolumesNegativeTest-2007710109 tempest-VolumesNegativeTest-2007710109-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/205b0415-21f8-409d-817b-b3f15e27097b" status: 404 len: 109 microversion: 2.1 time: 0.037171 Jun 16 19:07:15.008574 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 476/937] 10.222.0.70 () {58 vars in 1247 bytes} [Thu Jun 16 19:07:14 2022] DELETE /compute/v2.1/os-volumes/205b0415-21f8-409d-817b-b3f15e27097b => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:07:15.013513 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-752ac17d-8110-43b4-a7b4-abefafa72506 tempest-VolumesNegativeTest-2007710109 tempest-VolumesNegativeTest-2007710109-project] Calling method '.version_select at 0x7f12e5f10790>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:15.041293 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.wsgi [None req-752ac17d-8110-43b4-a7b4-abefafa72506 tempest-VolumesNegativeTest-2007710109 tempest-VolumesNegativeTest-2007710109-project] HTTP exception thrown: Volume 19c24446-0c48-4432-b33b-2af07d06b8dc could not be found. Jun 16 19:07:15.043429 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-752ac17d-8110-43b4-a7b4-abefafa72506 tempest-VolumesNegativeTest-2007710109 tempest-VolumesNegativeTest-2007710109-project] Request method failure captured: Jun 16 19:07:15.043429 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: request: GET /compute/v2.1/os-volumes/19c24446-0c48-4432-b33b-2af07d06b8dc HTTP/1.1 Jun 16 19:07:15.043429 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Accept: application/json Jun 16 19:07:15.043429 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Accept-Encoding: identity Jun 16 19:07:15.043429 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Connection: close Jun 16 19:07:15.043429 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Content-Length: 0 Jun 16 19:07:15.043429 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Content-Type: application/json Jun 16 19:07:15.043429 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Host: 10.222.0.70 Jun 16 19:07:15.043429 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Openstack-System-Scope: None Jun 16 19:07:15.043429 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: User-Agent: python-urllib3/1.26.9 Jun 16 19:07:15.043429 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Auth-Token: gAAAAABiq39iwdAzB9jirRJ9nS8GQGRNqGu_eQimcGjWMnXLZukjB59crJmMgM0X1UgGGIC0JH5H8w_E_PtongUUbxk3Gd6b-vMAH8NDcU7c0JhonPLfGxxU8Nc8BFYX6wi806-7HElrN00ow9Bxnasd2sCgsrirY4yHE56r4zPtBVkMDTJypEI Jun 16 19:07:15.043429 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Domain-Id: None Jun 16 19:07:15.043429 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Domain-Name: None Jun 16 19:07:15.043429 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Identity-Status: Confirmed Jun 16 19:07:15.043429 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Is-Admin-Project: True Jun 16 19:07:15.043429 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Domain-Id: default Jun 16 19:07:15.043429 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Domain-Name: Default Jun 16 19:07:15.043429 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Id: ddd0d6cc6ac0450fb85d4141fb62f4d5 Jun 16 19:07:15.043429 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Name: tempest-VolumesNegativeTest-2007710109 Jun 16 19:07:15.043429 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Role: member,reader Jun 16 19:07:15.043429 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Roles: member,reader Jun 16 19:07:15.045642 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ddd0d6cc6ac0450fb85d4141fb62f4d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_ddd0d6cc6ac0450fb85d4141fb62f4d5", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/ddd0d6cc6ac0450fb85d4141fb62f4d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ddd0d6cc6ac0450fb85d4141fb62f4d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 16 19:07:15.045642 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant: tempest-VolumesNegativeTest-2007710109 Jun 16 19:07:15.045642 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant-Id: ddd0d6cc6ac0450fb85d4141fb62f4d5 Jun 16 19:07:15.045642 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant-Name: tempest-VolumesNegativeTest-2007710109 Jun 16 19:07:15.045642 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User: tempest-VolumesNegativeTest-2007710109-project Jun 16 19:07:15.045642 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Domain-Id: default Jun 16 19:07:15.045642 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Domain-Name: Default Jun 16 19:07:15.045642 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Id: 7b6aeacd0c574098827be19ad11534fc Jun 16 19:07:15.045642 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Name: tempest-VolumesNegativeTest-2007710109-project Jun 16 19:07:15.045642 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: method: Jun 16 19:07:15.045642 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: exception: Volume 19c24446-0c48-4432-b33b-2af07d06b8dc could not be found. Jun 16 19:07:15.045642 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: action_args: {'id': '19c24446-0c48-4432-b33b-2af07d06b8dc'} Jun 16 19:07:15.045642 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:07:15.046661 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:07:15.046661 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 19:07:15.046661 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 19:07:15.046661 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 19:07:15.046661 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 19:07:15.046661 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 19:07:15.046661 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 19:07:15.046661 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 19:07:15.046661 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 19:07:15.046661 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 19:07:15.046661 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 19:07:15.046661 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 19:07:15.046661 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 19:07:15.046661 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 19:07:15.046661 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 19:07:15.046661 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 19c24446-0c48-4432-b33b-2af07d06b8dc could not be found. (HTTP 404) (Request-ID: req-2c1a56ff-f08c-4712-96a9-f32e97300bac) Jun 16 19:07:15.046661 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:07:15.046661 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:07:15.046661 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:07:15.048083 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:07:15.048083 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 19:07:15.048083 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 19:07:15.048083 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 19:07:15.048083 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 19:07:15.048083 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 19:07:15.048083 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 19:07:15.048083 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 19:07:15.048083 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 19:07:15.048083 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 19:07:15.048083 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 19:07:15.048083 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 19:07:15.048083 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 19:07:15.048083 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 19:07:15.048083 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 19:07:15.048083 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 19:07:15.048083 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 19:07:15.048083 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 19:07:15.048083 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 19:07:15.049519 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 19:07:15.049519 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 19:07:15.049519 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 19:07:15.049519 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 19:07:15.049519 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 19c24446-0c48-4432-b33b-2af07d06b8dc could not be found. Jun 16 19:07:15.049519 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:07:15.049519 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:07:15.049519 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:07:15.049519 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:07:15.049519 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:07:15.049519 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:07:15.049519 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:07:15.049519 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:07:15.049519 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 19:07:15.049519 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 19:07:15.049519 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:07:15.049519 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:07:15.049519 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 19:07:15.049519 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:07:15.050965 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 19c24446-0c48-4432-b33b-2af07d06b8dc could not be found. Jun 16 19:07:15.050965 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:07:15.050965 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:07:15.050965 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:07:15.050965 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:07:15.050965 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:07:15.050965 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:07:15.050965 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:07:15.050965 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:07:15.050965 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 19c24446-0c48-4432-b33b-2af07d06b8dc could not be found. Jun 16 19:07:15.050965 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:07:15.050965 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-752ac17d-8110-43b4-a7b4-abefafa72506 tempest-VolumesNegativeTest-2007710109 tempest-VolumesNegativeTest-2007710109-project] Returning 404 to user: Volume 19c24446-0c48-4432-b33b-2af07d06b8dc could not be found. {{(pid=117850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:07:15.050965 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-752ac17d-8110-43b4-a7b4-abefafa72506 tempest-VolumesNegativeTest-2007710109 tempest-VolumesNegativeTest-2007710109-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/19c24446-0c48-4432-b33b-2af07d06b8dc" status: 404 len: 109 microversion: 2.1 time: 0.036261 Jun 16 19:07:15.050965 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 462/938] 10.222.0.70 () {58 vars in 1244 bytes} [Thu Jun 16 19:07:15 2022] GET /compute/v2.1/os-volumes/19c24446-0c48-4432-b33b-2af07d06b8dc => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:07:23.070063 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-188c51a0-87a5-4cbf-b8a8-12b0a4c88d84 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:23.071027 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-188c51a0-87a5-4cbf-b8a8-12b0a4c88d84 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:23.078600 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-188c51a0-87a5-4cbf-b8a8-12b0a4c88d84 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:23.079048 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-188c51a0-87a5-4cbf-b8a8-12b0a4c88d84 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:23.079815 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-188c51a0-87a5-4cbf-b8a8-12b0a4c88d84 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:23.080250 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-188c51a0-87a5-4cbf-b8a8-12b0a4c88d84 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:23.113446 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-188c51a0-87a5-4cbf-b8a8-12b0a4c88d84 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048046 Jun 16 19:07:23.114365 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 477/939] 10.222.0.70 () {60 vars in 1342 bytes} [Thu Jun 16 19:07:23 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:07:23.174433 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-113c1187-1425-4d90-ac22-583638f3f16f tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:23.175084 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-113c1187-1425-4d90-ac22-583638f3f16f tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:23.183439 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-113c1187-1425-4d90-ac22-583638f3f16f tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:23.183909 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-113c1187-1425-4d90-ac22-583638f3f16f tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:23.189671 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-113c1187-1425-4d90-ac22-583638f3f16f tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:23.189671 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-113c1187-1425-4d90-ac22-583638f3f16f tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:23.212237 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-113c1187-1425-4d90-ac22-583638f3f16f tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Going to try to terminate instance {{(pid=117850) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:07:23.294513 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-113c1187-1425-4d90-ac22-583638f3f16f tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "DELETE /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 204 len: 0 microversion: 2.20 time: 0.123746 Jun 16 19:07:23.296511 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 463/940] 10.222.0.70 () {60 vars in 1279 bytes} [Thu Jun 16 19:07:23 2022] DELETE /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 19:07:23.308765 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-153208e6-21b4-413f-b999-8d1a7fa54e74 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:23.310382 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-153208e6-21b4-413f-b999-8d1a7fa54e74 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:23.316615 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-153208e6-21b4-413f-b999-8d1a7fa54e74 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:23.317072 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-153208e6-21b4-413f-b999-8d1a7fa54e74 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:23.317870 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-153208e6-21b4-413f-b999-8d1a7fa54e74 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:23.318307 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-153208e6-21b4-413f-b999-8d1a7fa54e74 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:23.467420 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-153208e6-21b4-413f-b999-8d1a7fa54e74 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:07:23.476814 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-153208e6-21b4-413f-b999-8d1a7fa54e74 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:07:23.478521 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-153208e6-21b4-413f-b999-8d1a7fa54e74 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:07:23.480954 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-153208e6-21b4-413f-b999-8d1a7fa54e74 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 200 len: 1725 microversion: 2.20 time: 0.177165 Jun 16 19:07:23.482440 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 478/941] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:07:23 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 1725 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 19:07:24.501787 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-a05484d1-e54f-4747-8433-818d17e5aa93 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:24.502488 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-a05484d1-e54f-4747-8433-818d17e5aa93 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:24.508905 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-a05484d1-e54f-4747-8433-818d17e5aa93 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:24.509352 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-a05484d1-e54f-4747-8433-818d17e5aa93 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:24.510104 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-a05484d1-e54f-4747-8433-818d17e5aa93 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:24.510538 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-a05484d1-e54f-4747-8433-818d17e5aa93 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:24.648334 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-a05484d1-e54f-4747-8433-818d17e5aa93 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:07:24.656958 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-a05484d1-e54f-4747-8433-818d17e5aa93 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:07:24.658471 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-a05484d1-e54f-4747-8433-818d17e5aa93 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:07:24.659745 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-a05484d1-e54f-4747-8433-818d17e5aa93 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 200 len: 1725 microversion: 2.20 time: 0.162865 Jun 16 19:07:24.660292 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 464/942] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:07:24 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:07:25.679853 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-7fe21b4a-4bf5-45a9-8465-86c0f87ad2e8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:25.680673 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-7fe21b4a-4bf5-45a9-8465-86c0f87ad2e8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:25.687396 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-7fe21b4a-4bf5-45a9-8465-86c0f87ad2e8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:25.687847 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-7fe21b4a-4bf5-45a9-8465-86c0f87ad2e8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:25.688619 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-7fe21b4a-4bf5-45a9-8465-86c0f87ad2e8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:25.689057 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-7fe21b4a-4bf5-45a9-8465-86c0f87ad2e8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:25.757282 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-7fe21b4a-4bf5-45a9-8465-86c0f87ad2e8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:07:25.759674 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [req-bb47e328-b67f-4729-a67d-632ab2dfd775 req-5d244d70-ad33-483e-b5c7-d4594f41b75a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac8de877-3a07-4017-99fb-45b37ef123b6", "name": "network-vif-deleted", "tag": "8bd9db24-3ac1-4beb-93fd-9cdfca791f22"}]} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:07:25.766909 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-7fe21b4a-4bf5-45a9-8465-86c0f87ad2e8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:07:25.769387 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-7fe21b4a-4bf5-45a9-8465-86c0f87ad2e8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '04327f3d7b844ddb88cf4a81145634c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '057aef18c52b49a382450331694c04d6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:07:25.770752 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-7fe21b4a-4bf5-45a9-8465-86c0f87ad2e8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 200 len: 1657 microversion: 2.20 time: 0.094851 Jun 16 19:07:25.771523 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 479/943] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:07:25 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 1657 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 19:07:25.781282 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-bb47e328-b67f-4729-a67d-632ab2dfd775 req-5d244d70-ad33-483e-b5c7-d4594f41b75a service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:25.782006 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-bb47e328-b67f-4729-a67d-632ab2dfd775 req-5d244d70-ad33-483e-b5c7-d4594f41b75a service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:25.796109 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.compute.server_external_events [req-bb47e328-b67f-4729-a67d-632ab2dfd775 req-5d244d70-ad33-483e-b5c7-d4594f41b75a service nova] Creating event network-vif-deleted:8bd9db24-3ac1-4beb-93fd-9cdfca791f22 for instance ac8de877-3a07-4017-99fb-45b37ef123b6 on hv-cinder-84617 Jun 16 19:07:25.803034 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [req-bb47e328-b67f-4729-a67d-632ab2dfd775 req-5d244d70-ad33-483e-b5c7-d4594f41b75a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046811 Jun 16 19:07:25.804589 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 465/944] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:07:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:07:26.790746 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-d6627253-00b8-4ef2-bc0d-0c9043f5da6e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:26.791479 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-d6627253-00b8-4ef2-bc0d-0c9043f5da6e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:26.799021 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d6627253-00b8-4ef2-bc0d-0c9043f5da6e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:26.799474 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d6627253-00b8-4ef2-bc0d-0c9043f5da6e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:26.800251 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d6627253-00b8-4ef2-bc0d-0c9043f5da6e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:26.800871 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d6627253-00b8-4ef2-bc0d-0c9043f5da6e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:26.823364 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.wsgi [None req-d6627253-00b8-4ef2-bc0d-0c9043f5da6e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] HTTP exception thrown: Instance ac8de877-3a07-4017-99fb-45b37ef123b6 could not be found. Jun 16 19:07:26.827162 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-d6627253-00b8-4ef2-bc0d-0c9043f5da6e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Request method failure captured: Jun 16 19:07:26.827162 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: request: GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 HTTP/1.1 Jun 16 19:07:26.827162 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Accept: application/json Jun 16 19:07:26.827162 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Accept-Encoding: identity Jun 16 19:07:26.827162 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Connection: close Jun 16 19:07:26.827162 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Content-Length: 0 Jun 16 19:07:26.827162 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Content-Type: application/json Jun 16 19:07:26.827162 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Host: 10.222.0.70 Jun 16 19:07:26.827162 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Openstack-System-Scope: None Jun 16 19:07:26.827162 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: User-Agent: python-urllib3/1.26.9 Jun 16 19:07:26.827162 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Auth-Token: gAAAAABiq32OQiza-NSy8hW_I29443OfPOvR91QNA9ClbVuA-Bbd5xRGQHwQYumw9wG3Iz--EsTEyKvr7WbWYvDTJ66Dh8zuZcOad2PTE_vlGjyzTmbcL5O3rlxOIwqedWIoQqpJmwDL8kDUbc1txpCl8MtEXCrt-37yneyXWSj7JbCe7k7eTU0 Jun 16 19:07:26.827162 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Domain-Id: None Jun 16 19:07:26.827162 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Domain-Name: None Jun 16 19:07:26.827162 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Identity-Status: Confirmed Jun 16 19:07:26.827162 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Is-Admin-Project: True Jun 16 19:07:26.827162 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 19:07:26.827162 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Domain-Id: default Jun 16 19:07:26.827162 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Domain-Name: Default Jun 16 19:07:26.827162 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Id: 057aef18c52b49a382450331694c04d6 Jun 16 19:07:26.827162 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1010047508 Jun 16 19:07:26.827162 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Role: member,reader Jun 16 19:07:26.827162 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Roles: member,reader Jun 16 19:07:26.828961 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/057aef18c52b49a382450331694c04d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_057aef18c52b49a382450331694c04d6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/057aef18c52b49a382450331694c04d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/057aef18c52b49a382450331694c04d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 16 19:07:26.828961 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1010047508 Jun 16 19:07:26.828961 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant-Id: 057aef18c52b49a382450331694c04d6 Jun 16 19:07:26.828961 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1010047508 Jun 16 19:07:26.828961 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User: tempest-AttachVolumeShelveTestJSON-1010047508-project Jun 16 19:07:26.828961 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Domain-Id: default Jun 16 19:07:26.828961 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Domain-Name: Default Jun 16 19:07:26.828961 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Id: 04327f3d7b844ddb88cf4a81145634c4 Jun 16 19:07:26.828961 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1010047508-project Jun 16 19:07:26.828961 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: method: > Jun 16 19:07:26.828961 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: exception: Instance ac8de877-3a07-4017-99fb-45b37ef123b6 could not be found. Jun 16 19:07:26.828961 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: action_args: {'id': 'ac8de877-3a07-4017-99fb-45b37ef123b6'} Jun 16 19:07:26.829862 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:07:26.829862 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:07:26.829862 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:07:26.829862 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:07:26.829862 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:07:26.829862 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:07:26.829862 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:07:26.829862 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:07:26.829862 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:07:26.829862 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:07:26.829862 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac8de877-3a07-4017-99fb-45b37ef123b6 could not be found. Jun 16 19:07:26.829862 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:07:26.829862 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:07:26.829862 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:07:26.829862 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:07:26.829862 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:07:26.829862 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:07:26.829862 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:07:26.829862 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:07:26.829862 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:07:26.831425 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:07:26.831425 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:07:26.831425 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:07:26.831425 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:07:26.831425 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:07:26.831425 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:07:26.831425 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:07:26.831425 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac8de877-3a07-4017-99fb-45b37ef123b6 could not be found. Jun 16 19:07:26.831425 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:07:26.831425 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:07:26.831425 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:07:26.831425 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:07:26.831425 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:07:26.831425 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:07:26.831425 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:07:26.831425 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:07:26.831425 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac8de877-3a07-4017-99fb-45b37ef123b6 could not be found. Jun 16 19:07:26.831425 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:07:26.832754 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-d6627253-00b8-4ef2-bc0d-0c9043f5da6e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Returning 404 to user: Instance ac8de877-3a07-4017-99fb-45b37ef123b6 could not be found. {{(pid=117852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:07:26.832754 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-d6627253-00b8-4ef2-bc0d-0c9043f5da6e tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 404 len: 111 microversion: 2.20 time: 0.042928 Jun 16 19:07:26.834643 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 480/945] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:07:26 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 19:07:26.840906 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-b7221248-9a8d-48f0-8809-98afd88de8ca tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '.version_select at 0x7f12e5f10af0>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:26.859902 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-b7221248-9a8d-48f0-8809-98afd88de8ca tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1108086237" status: 204 len: 0 microversion: 2.20 time: 0.023784 Jun 16 19:07:26.863781 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 466/946] 10.222.0.70 () {60 vars in 1261 bytes} [Thu Jun 16 19:07:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1108086237 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 19:07:28.783755 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-f840866d-4529-4dd2-bf5e-c26778022180 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:28.784312 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-f840866d-4529-4dd2-bf5e-c26778022180 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:28.790667 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f840866d-4529-4dd2-bf5e-c26778022180 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:28.791123 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f840866d-4529-4dd2-bf5e-c26778022180 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:28.791896 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f840866d-4529-4dd2-bf5e-c26778022180 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:28.792334 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f840866d-4529-4dd2-bf5e-c26778022180 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:28.807214 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.wsgi [None req-f840866d-4529-4dd2-bf5e-c26778022180 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] HTTP exception thrown: Instance ac8de877-3a07-4017-99fb-45b37ef123b6 could not be found. Jun 16 19:07:28.808758 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-f840866d-4529-4dd2-bf5e-c26778022180 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Request method failure captured: Jun 16 19:07:28.808758 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: request: DELETE /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 HTTP/1.1 Jun 16 19:07:28.808758 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Accept: application/json Jun 16 19:07:28.808758 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Accept-Encoding: identity Jun 16 19:07:28.808758 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Connection: close Jun 16 19:07:28.808758 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Content-Length: 0 Jun 16 19:07:28.808758 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Content-Type: application/json Jun 16 19:07:28.808758 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Host: 10.222.0.70 Jun 16 19:07:28.808758 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Openstack-System-Scope: None Jun 16 19:07:28.808758 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: User-Agent: python-urllib3/1.26.9 Jun 16 19:07:28.808758 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Auth-Token: gAAAAABiq32OQiza-NSy8hW_I29443OfPOvR91QNA9ClbVuA-Bbd5xRGQHwQYumw9wG3Iz--EsTEyKvr7WbWYvDTJ66Dh8zuZcOad2PTE_vlGjyzTmbcL5O3rlxOIwqedWIoQqpJmwDL8kDUbc1txpCl8MtEXCrt-37yneyXWSj7JbCe7k7eTU0 Jun 16 19:07:28.808758 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Domain-Id: None Jun 16 19:07:28.808758 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Domain-Name: None Jun 16 19:07:28.808758 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Identity-Status: Confirmed Jun 16 19:07:28.808758 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Is-Admin-Project: True Jun 16 19:07:28.808758 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 19:07:28.808758 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Domain-Id: default Jun 16 19:07:28.808758 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Domain-Name: Default Jun 16 19:07:28.808758 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Id: 057aef18c52b49a382450331694c04d6 Jun 16 19:07:28.808758 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1010047508 Jun 16 19:07:28.808758 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Role: member,reader Jun 16 19:07:28.808758 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Roles: member,reader Jun 16 19:07:28.810459 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/057aef18c52b49a382450331694c04d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_057aef18c52b49a382450331694c04d6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/057aef18c52b49a382450331694c04d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/057aef18c52b49a382450331694c04d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 16 19:07:28.810459 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1010047508 Jun 16 19:07:28.810459 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant-Id: 057aef18c52b49a382450331694c04d6 Jun 16 19:07:28.810459 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1010047508 Jun 16 19:07:28.810459 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User: tempest-AttachVolumeShelveTestJSON-1010047508-project Jun 16 19:07:28.810459 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Domain-Id: default Jun 16 19:07:28.810459 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Domain-Name: Default Jun 16 19:07:28.810459 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Id: 04327f3d7b844ddb88cf4a81145634c4 Jun 16 19:07:28.810459 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1010047508-project Jun 16 19:07:28.810459 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: method: > Jun 16 19:07:28.810459 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: exception: Instance ac8de877-3a07-4017-99fb-45b37ef123b6 could not be found. Jun 16 19:07:28.810459 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: action_args: {'id': 'ac8de877-3a07-4017-99fb-45b37ef123b6'} Jun 16 19:07:28.811401 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:07:28.811401 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:07:28.811401 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:07:28.811401 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:07:28.811401 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:07:28.811401 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:07:28.811401 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:07:28.811401 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:07:28.811401 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:07:28.811401 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:07:28.811401 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac8de877-3a07-4017-99fb-45b37ef123b6 could not be found. Jun 16 19:07:28.811401 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:07:28.811401 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:07:28.811401 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:07:28.811401 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:07:28.811401 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:07:28.811401 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:07:28.811401 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:07:28.811401 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:07:28.811401 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:07:28.812900 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:07:28.812900 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 19:07:28.812900 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 19:07:28.812900 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 19:07:28.812900 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 19:07:28.812900 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:07:28.812900 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:07:28.812900 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:07:28.812900 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:07:28.812900 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac8de877-3a07-4017-99fb-45b37ef123b6 could not be found. Jun 16 19:07:28.812900 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:07:28.812900 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:07:28.812900 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:07:28.812900 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:07:28.812900 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:07:28.812900 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:07:28.812900 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:07:28.812900 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:07:28.812900 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac8de877-3a07-4017-99fb-45b37ef123b6 could not be found. Jun 16 19:07:28.812900 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:07:28.814386 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-f840866d-4529-4dd2-bf5e-c26778022180 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Returning 404 to user: Instance ac8de877-3a07-4017-99fb-45b37ef123b6 could not be found. {{(pid=117852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:07:28.814386 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-f840866d-4529-4dd2-bf5e-c26778022180 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "DELETE /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 404 len: 111 microversion: 2.20 time: 0.030682 Jun 16 19:07:28.814386 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 481/947] 10.222.0.70 () {60 vars in 1279 bytes} [Thu Jun 16 19:07:28 2022] DELETE /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 16 19:07:28.823824 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-1fe19f5d-3759-4663-8f20-1afc8e5b2b18 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:28.825179 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-1fe19f5d-3759-4663-8f20-1afc8e5b2b18 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: ac8de877-3a07-4017-99fb-45b37ef123b6] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:28.833588 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-1fe19f5d-3759-4663-8f20-1afc8e5b2b18 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:28.834050 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-1fe19f5d-3759-4663-8f20-1afc8e5b2b18 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:28.834863 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-1fe19f5d-3759-4663-8f20-1afc8e5b2b18 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:28.835308 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-1fe19f5d-3759-4663-8f20-1afc8e5b2b18 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:28.849880 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.wsgi [None req-1fe19f5d-3759-4663-8f20-1afc8e5b2b18 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] HTTP exception thrown: Instance ac8de877-3a07-4017-99fb-45b37ef123b6 could not be found. Jun 16 19:07:28.851665 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-1fe19f5d-3759-4663-8f20-1afc8e5b2b18 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Request method failure captured: Jun 16 19:07:28.851665 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: request: GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 HTTP/1.1 Jun 16 19:07:28.851665 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Accept: application/json Jun 16 19:07:28.851665 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Accept-Encoding: identity Jun 16 19:07:28.851665 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Connection: close Jun 16 19:07:28.851665 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Content-Length: 0 Jun 16 19:07:28.851665 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Content-Type: application/json Jun 16 19:07:28.851665 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Host: 10.222.0.70 Jun 16 19:07:28.851665 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Openstack-System-Scope: None Jun 16 19:07:28.851665 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: User-Agent: python-urllib3/1.26.9 Jun 16 19:07:28.851665 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Auth-Token: gAAAAABiq32OQiza-NSy8hW_I29443OfPOvR91QNA9ClbVuA-Bbd5xRGQHwQYumw9wG3Iz--EsTEyKvr7WbWYvDTJ66Dh8zuZcOad2PTE_vlGjyzTmbcL5O3rlxOIwqedWIoQqpJmwDL8kDUbc1txpCl8MtEXCrt-37yneyXWSj7JbCe7k7eTU0 Jun 16 19:07:28.851665 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Domain-Id: None Jun 16 19:07:28.851665 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Domain-Name: None Jun 16 19:07:28.851665 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Identity-Status: Confirmed Jun 16 19:07:28.851665 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Is-Admin-Project: True Jun 16 19:07:28.851665 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 19:07:28.851665 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Domain-Id: default Jun 16 19:07:28.851665 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Domain-Name: Default Jun 16 19:07:28.851665 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Id: 057aef18c52b49a382450331694c04d6 Jun 16 19:07:28.851665 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1010047508 Jun 16 19:07:28.851665 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Role: member,reader Jun 16 19:07:28.851665 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Roles: member,reader Jun 16 19:07:28.853378 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/057aef18c52b49a382450331694c04d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_057aef18c52b49a382450331694c04d6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/057aef18c52b49a382450331694c04d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/057aef18c52b49a382450331694c04d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 16 19:07:28.853378 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1010047508 Jun 16 19:07:28.853378 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant-Id: 057aef18c52b49a382450331694c04d6 Jun 16 19:07:28.853378 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1010047508 Jun 16 19:07:28.853378 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User: tempest-AttachVolumeShelveTestJSON-1010047508-project Jun 16 19:07:28.853378 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Domain-Id: default Jun 16 19:07:28.853378 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Domain-Name: Default Jun 16 19:07:28.853378 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Id: 04327f3d7b844ddb88cf4a81145634c4 Jun 16 19:07:28.853378 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1010047508-project Jun 16 19:07:28.853378 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: method: > Jun 16 19:07:28.853378 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: exception: Instance ac8de877-3a07-4017-99fb-45b37ef123b6 could not be found. Jun 16 19:07:28.853378 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: action_args: {'id': 'ac8de877-3a07-4017-99fb-45b37ef123b6'} Jun 16 19:07:28.854276 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:07:28.854276 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:07:28.854276 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:07:28.854276 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:07:28.854276 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:07:28.854276 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:07:28.854276 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:07:28.854276 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:07:28.854276 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:07:28.854276 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:07:28.854276 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac8de877-3a07-4017-99fb-45b37ef123b6 could not be found. Jun 16 19:07:28.854276 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:07:28.854276 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:07:28.854276 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:07:28.854276 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:07:28.854276 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:07:28.854276 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:07:28.854276 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:07:28.854276 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:07:28.854276 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:07:28.855908 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:07:28.855908 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:07:28.855908 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:07:28.855908 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:07:28.855908 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:07:28.855908 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:07:28.855908 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:07:28.855908 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac8de877-3a07-4017-99fb-45b37ef123b6 could not be found. Jun 16 19:07:28.855908 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:07:28.855908 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:07:28.855908 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:07:28.855908 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:07:28.855908 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:07:28.855908 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:07:28.855908 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:07:28.855908 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:07:28.855908 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac8de877-3a07-4017-99fb-45b37ef123b6 could not be found. Jun 16 19:07:28.855908 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:07:28.857696 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-1fe19f5d-3759-4663-8f20-1afc8e5b2b18 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Returning 404 to user: Instance ac8de877-3a07-4017-99fb-45b37ef123b6 could not be found. {{(pid=117850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:07:28.857696 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-1fe19f5d-3759-4663-8f20-1afc8e5b2b18 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6" status: 404 len: 111 microversion: 2.20 time: 0.034113 Jun 16 19:07:28.857696 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 467/948] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:07:28 2022] GET /compute/v2.1/servers/ac8de877-3a07-4017-99fb-45b37ef123b6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 19:07:30.009833 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-1904abf0-f889-46e3-8a35-bfa339ea7fa0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:30.010927 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-1904abf0-f889-46e3-8a35-bfa339ea7fa0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:30.019598 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-1904abf0-f889-46e3-8a35-bfa339ea7fa0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:30.020049 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-1904abf0-f889-46e3-8a35-bfa339ea7fa0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:30.021014 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-1904abf0-f889-46e3-8a35-bfa339ea7fa0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:30.021457 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-1904abf0-f889-46e3-8a35-bfa339ea7fa0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:30.036987 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.wsgi [None req-1904abf0-f889-46e3-8a35-bfa339ea7fa0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] HTTP exception thrown: Instance 1c077a29-12e0-48af-a8b6-43d0b5a79bf4 could not be found. Jun 16 19:07:30.038562 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-1904abf0-f889-46e3-8a35-bfa339ea7fa0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Request method failure captured: Jun 16 19:07:30.038562 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: request: DELETE /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 HTTP/1.1 Jun 16 19:07:30.038562 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Accept: application/json Jun 16 19:07:30.038562 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Accept-Encoding: identity Jun 16 19:07:30.038562 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Connection: close Jun 16 19:07:30.038562 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Content-Length: 0 Jun 16 19:07:30.038562 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Content-Type: application/json Jun 16 19:07:30.038562 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Host: 10.222.0.70 Jun 16 19:07:30.038562 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Openstack-System-Scope: None Jun 16 19:07:30.038562 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: User-Agent: python-urllib3/1.26.9 Jun 16 19:07:30.038562 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Auth-Token: gAAAAABiq32OQiza-NSy8hW_I29443OfPOvR91QNA9ClbVuA-Bbd5xRGQHwQYumw9wG3Iz--EsTEyKvr7WbWYvDTJ66Dh8zuZcOad2PTE_vlGjyzTmbcL5O3rlxOIwqedWIoQqpJmwDL8kDUbc1txpCl8MtEXCrt-37yneyXWSj7JbCe7k7eTU0 Jun 16 19:07:30.038562 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Domain-Id: None Jun 16 19:07:30.038562 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Domain-Name: None Jun 16 19:07:30.038562 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Identity-Status: Confirmed Jun 16 19:07:30.038562 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Is-Admin-Project: True Jun 16 19:07:30.038562 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 19:07:30.038562 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Domain-Id: default Jun 16 19:07:30.038562 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Domain-Name: Default Jun 16 19:07:30.038562 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Id: 057aef18c52b49a382450331694c04d6 Jun 16 19:07:30.038562 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1010047508 Jun 16 19:07:30.038562 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Role: member,reader Jun 16 19:07:30.038562 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Roles: member,reader Jun 16 19:07:30.040219 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/057aef18c52b49a382450331694c04d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_057aef18c52b49a382450331694c04d6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/057aef18c52b49a382450331694c04d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/057aef18c52b49a382450331694c04d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 16 19:07:30.040219 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1010047508 Jun 16 19:07:30.040219 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant-Id: 057aef18c52b49a382450331694c04d6 Jun 16 19:07:30.040219 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1010047508 Jun 16 19:07:30.040219 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User: tempest-AttachVolumeShelveTestJSON-1010047508-project Jun 16 19:07:30.040219 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Domain-Id: default Jun 16 19:07:30.040219 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Domain-Name: Default Jun 16 19:07:30.040219 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Id: 04327f3d7b844ddb88cf4a81145634c4 Jun 16 19:07:30.040219 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1010047508-project Jun 16 19:07:30.040219 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: method: > Jun 16 19:07:30.040219 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: exception: Instance 1c077a29-12e0-48af-a8b6-43d0b5a79bf4 could not be found. Jun 16 19:07:30.040219 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: action_args: {'id': '1c077a29-12e0-48af-a8b6-43d0b5a79bf4'} Jun 16 19:07:30.041071 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:07:30.041071 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:07:30.041071 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:07:30.041071 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:07:30.041071 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:07:30.041071 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:07:30.041071 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:07:30.041071 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:07:30.041071 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:07:30.041071 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:07:30.041071 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c077a29-12e0-48af-a8b6-43d0b5a79bf4 could not be found. Jun 16 19:07:30.041071 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:07:30.041071 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:07:30.041071 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:07:30.041071 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:07:30.041071 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:07:30.041071 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:07:30.041071 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:07:30.041071 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:07:30.041071 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:07:30.042397 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:07:30.042397 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 19:07:30.042397 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 19:07:30.042397 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 19:07:30.042397 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 19:07:30.042397 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:07:30.042397 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:07:30.042397 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:07:30.042397 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:07:30.042397 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c077a29-12e0-48af-a8b6-43d0b5a79bf4 could not be found. Jun 16 19:07:30.042397 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:07:30.042397 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:07:30.042397 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:07:30.042397 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:07:30.042397 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:07:30.042397 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:07:30.042397 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:07:30.042397 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:07:30.042397 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c077a29-12e0-48af-a8b6-43d0b5a79bf4 could not be found. Jun 16 19:07:30.042397 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:07:30.044459 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-1904abf0-f889-46e3-8a35-bfa339ea7fa0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Returning 404 to user: Instance 1c077a29-12e0-48af-a8b6-43d0b5a79bf4 could not be found. {{(pid=117852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:07:30.044459 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-1904abf0-f889-46e3-8a35-bfa339ea7fa0 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "DELETE /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 404 len: 111 microversion: 2.20 time: 0.034056 Jun 16 19:07:30.044459 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 482/949] 10.222.0.70 () {60 vars in 1279 bytes} [Thu Jun 16 19:07:30 2022] DELETE /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 19:07:30.051224 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-275c3a12-c30a-444b-be7d-20fde2c0ddf8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:30.051224 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-275c3a12-c30a-444b-be7d-20fde2c0ddf8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] [instance: 1c077a29-12e0-48af-a8b6-43d0b5a79bf4] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:30.057228 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-275c3a12-c30a-444b-be7d-20fde2c0ddf8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:30.057707 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-275c3a12-c30a-444b-be7d-20fde2c0ddf8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:30.058562 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-275c3a12-c30a-444b-be7d-20fde2c0ddf8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:30.059059 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-275c3a12-c30a-444b-be7d-20fde2c0ddf8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:30.073717 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.wsgi [None req-275c3a12-c30a-444b-be7d-20fde2c0ddf8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] HTTP exception thrown: Instance 1c077a29-12e0-48af-a8b6-43d0b5a79bf4 could not be found. Jun 16 19:07:30.075905 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-275c3a12-c30a-444b-be7d-20fde2c0ddf8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Request method failure captured: Jun 16 19:07:30.075905 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: request: GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 HTTP/1.1 Jun 16 19:07:30.075905 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Accept: application/json Jun 16 19:07:30.075905 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Accept-Encoding: identity Jun 16 19:07:30.075905 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Connection: close Jun 16 19:07:30.075905 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Content-Length: 0 Jun 16 19:07:30.075905 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Content-Type: application/json Jun 16 19:07:30.075905 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Host: 10.222.0.70 Jun 16 19:07:30.075905 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Openstack-System-Scope: None Jun 16 19:07:30.075905 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: User-Agent: python-urllib3/1.26.9 Jun 16 19:07:30.075905 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Auth-Token: gAAAAABiq32OQiza-NSy8hW_I29443OfPOvR91QNA9ClbVuA-Bbd5xRGQHwQYumw9wG3Iz--EsTEyKvr7WbWYvDTJ66Dh8zuZcOad2PTE_vlGjyzTmbcL5O3rlxOIwqedWIoQqpJmwDL8kDUbc1txpCl8MtEXCrt-37yneyXWSj7JbCe7k7eTU0 Jun 16 19:07:30.075905 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Domain-Id: None Jun 16 19:07:30.075905 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Domain-Name: None Jun 16 19:07:30.075905 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Identity-Status: Confirmed Jun 16 19:07:30.075905 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Is-Admin-Project: True Jun 16 19:07:30.075905 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 19:07:30.075905 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Domain-Id: default Jun 16 19:07:30.075905 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Domain-Name: Default Jun 16 19:07:30.075905 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Id: 057aef18c52b49a382450331694c04d6 Jun 16 19:07:30.075905 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1010047508 Jun 16 19:07:30.075905 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Role: member,reader Jun 16 19:07:30.075905 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Roles: member,reader Jun 16 19:07:30.077668 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/057aef18c52b49a382450331694c04d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_057aef18c52b49a382450331694c04d6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/057aef18c52b49a382450331694c04d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/057aef18c52b49a382450331694c04d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 16 19:07:30.077668 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1010047508 Jun 16 19:07:30.077668 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant-Id: 057aef18c52b49a382450331694c04d6 Jun 16 19:07:30.077668 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1010047508 Jun 16 19:07:30.077668 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User: tempest-AttachVolumeShelveTestJSON-1010047508-project Jun 16 19:07:30.077668 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Domain-Id: default Jun 16 19:07:30.077668 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Domain-Name: Default Jun 16 19:07:30.077668 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Id: 04327f3d7b844ddb88cf4a81145634c4 Jun 16 19:07:30.077668 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1010047508-project Jun 16 19:07:30.077668 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: method: > Jun 16 19:07:30.077668 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: exception: Instance 1c077a29-12e0-48af-a8b6-43d0b5a79bf4 could not be found. Jun 16 19:07:30.077668 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: action_args: {'id': '1c077a29-12e0-48af-a8b6-43d0b5a79bf4'} Jun 16 19:07:30.078657 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:07:30.078657 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:07:30.078657 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:07:30.078657 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:07:30.078657 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:07:30.078657 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:07:30.078657 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:07:30.078657 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:07:30.078657 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:07:30.078657 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:07:30.078657 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c077a29-12e0-48af-a8b6-43d0b5a79bf4 could not be found. Jun 16 19:07:30.078657 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:07:30.078657 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:07:30.078657 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:07:30.078657 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:07:30.078657 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:07:30.078657 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:07:30.078657 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:07:30.078657 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:07:30.078657 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:07:30.080131 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:07:30.080131 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:07:30.080131 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:07:30.080131 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:07:30.080131 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:07:30.080131 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:07:30.080131 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:07:30.080131 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c077a29-12e0-48af-a8b6-43d0b5a79bf4 could not be found. Jun 16 19:07:30.080131 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:07:30.080131 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:07:30.080131 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:07:30.080131 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:07:30.080131 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:07:30.080131 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:07:30.080131 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:07:30.080131 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:07:30.080131 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c077a29-12e0-48af-a8b6-43d0b5a79bf4 could not be found. Jun 16 19:07:30.080131 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:07:30.082242 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-275c3a12-c30a-444b-be7d-20fde2c0ddf8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] Returning 404 to user: Instance 1c077a29-12e0-48af-a8b6-43d0b5a79bf4 could not be found. {{(pid=117850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:07:30.083355 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-275c3a12-c30a-444b-be7d-20fde2c0ddf8 tempest-AttachVolumeShelveTestJSON-1010047508 tempest-AttachVolumeShelveTestJSON-1010047508-project] 10.222.0.70 "GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4" status: 404 len: 111 microversion: 2.20 time: 0.037850 Jun 16 19:07:30.084836 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 468/950] 10.222.0.70 () {60 vars in 1276 bytes} [Thu Jun 16 19:07:30 2022] GET /compute/v2.1/servers/1c077a29-12e0-48af-a8b6-43d0b5a79bf4 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 19:07:39.608863 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-d9064058-a651-4618-bbbd-96d45ec486d2 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Action: 'create', calling method: .version_select at 0x7f12e5cbc790>, body: {"keypair": {"name": "tempest-keypair-1659385324", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOv3X5kCt2VcI5LuMaDMht3ElSjGf5OD0332d+gcjHXJ4sBIrhR/16vozm7bT9A8WsSyHeUfTiZLqKSBlZzVwS3NlV8PQkIGfTSQvZnTTkXs6U1LCJRMJuFUhh5hdEzYxw=="}} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:07:39.626095 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.quota [None req-d9064058-a651-4618-bbbd-96d45ec486d2 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Getting quotas for project bf39ecb69ea7474d940ad17f8bab4874. Resources: {'key_pairs'} {{(pid=117852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:07:39.630530 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.quota [None req-d9064058-a651-4618-bbbd-96d45ec486d2 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Getting quotas for user 55f5aba8355c436b94508156bca24ab3 and project bf39ecb69ea7474d940ad17f8bab4874. Resources: {'key_pairs'} {{(pid=117852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:07:39.649216 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d9064058-a651-4618-bbbd-96d45ec486d2 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [fc570851-d07d-43ba-b2df-ea1fd2786e32] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 16 19:07:40.027347 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_cell1:SELECT=24 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:07:40.659920 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO oslo.messaging._drivers.impl_rabbit [None req-d9064058-a651-4618-bbbd-96d45ec486d2 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [fc570851-d07d-43ba-b2df-ea1fd2786e32] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 41916. Jun 16 19:07:40.679358 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-d9064058-a651-4618-bbbd-96d45ec486d2 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.379082 Jun 16 19:07:40.679954 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 483/951] 10.222.0.70 () {60 vars in 1158 bytes} [Thu Jun 16 19:07:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:07:42.107661 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-fb86b053-7934-43a1-b29a-cbc52c7bf577 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1630621926", "imageRef": "1d993e69-7f01-4fe0-ba52-0eae2fa43ddf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "16a4eb33-8dce-42a9-8f45-666580159bfa"}], "security_groups": [{"name": "tempest-securitygroup--245226600"}], "key_name": "tempest-keypair-1659385324", "user_data": "}} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:07:42.115683 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:07:42.117188 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:07:42.236752 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.network.neutron [None req-fb86b053-7934-43a1-b29a-cbc52c7bf577 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] validate_networks() for [('16a4eb33-8dce-42a9-8f45-666580159bfa', None, None, None, None, None)] {{(pid=117850) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:07:42.643787 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-fb86b053-7934-43a1-b29a-cbc52c7bf577 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Flavor limits 0:0:0 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:07:42.644294 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-fb86b053-7934-43a1-b29a-cbc52c7bf577 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Image limits 0:0:0 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:07:42.644779 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-fb86b053-7934-43a1-b29a-cbc52c7bf577 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Flavor pref 0:0:0 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:07:42.645192 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-fb86b053-7934-43a1-b29a-cbc52c7bf577 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Image pref 0:0:0 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:07:42.645723 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-fb86b053-7934-43a1-b29a-cbc52c7bf577 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:07:42.656212 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-fb86b053-7934-43a1-b29a-cbc52c7bf577 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:42.656667 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-fb86b053-7934-43a1-b29a-cbc52c7bf577 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:42.657467 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-fb86b053-7934-43a1-b29a-cbc52c7bf577 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:42.658097 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-fb86b053-7934-43a1-b29a-cbc52c7bf577 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:42.676661 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.quota [None req-fb86b053-7934-43a1-b29a-cbc52c7bf577 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Getting quotas for project bf39ecb69ea7474d940ad17f8bab4874. Resources: {'cores', 'ram', 'instances'} {{(pid=117850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:07:42.680714 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.quota [None req-fb86b053-7934-43a1-b29a-cbc52c7bf577 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Getting quotas for user 55f5aba8355c436b94508156bca24ab3 and project bf39ecb69ea7474d940ad17f8bab4874. Resources: {'cores', 'ram', 'instances'} {{(pid=117850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:07:42.693975 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-fb86b053-7934-43a1-b29a-cbc52c7bf577 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Going to run 1 instances... {{(pid=117850) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:07:42.696366 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-fb86b053-7934-43a1-b29a-cbc52c7bf577 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 7a805bc0-29bf-4ca0-80b2-e2ee71912d51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1d993e69-7f01-4fe0-ba52-0eae2fa43ddf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:07:42.758487 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-fb86b053-7934-43a1-b29a-cbc52c7bf577 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.656265 Jun 16 19:07:42.765651 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 469/952] 10.222.0.70 () {60 vars in 1146 bytes} [Thu Jun 16 19:07:42 2022] POST /compute/v2.1/servers => generated 401 bytes in 658 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:07:42.772017 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-645b5a39-acde-446f-afb5-726c34dafe7e tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:42.772690 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-645b5a39-acde-446f-afb5-726c34dafe7e tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 7a805bc0-29bf-4ca0-80b2-e2ee71912d51] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:42.872377 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-645b5a39-acde-446f-afb5-726c34dafe7e tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f5aba8355c436b94508156bca24ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf39ecb69ea7474d940ad17f8bab4874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:07:42.886442 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-645b5a39-acde-446f-afb5-726c34dafe7e tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/7a805bc0-29bf-4ca0-80b2-e2ee71912d51" status: 200 len: 1242 microversion: 2.1 time: 0.119199 Jun 16 19:07:42.888818 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 484/953] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:07:42 2022] GET /compute/v2.1/servers/7a805bc0-29bf-4ca0-80b2-e2ee71912d51 => generated 1242 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:07:43.907451 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-600f8552-a2bc-4c89-a84c-04f1229436ed tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:43.908317 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-600f8552-a2bc-4c89-a84c-04f1229436ed tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 7a805bc0-29bf-4ca0-80b2-e2ee71912d51] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:43.917404 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-600f8552-a2bc-4c89-a84c-04f1229436ed tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:43.917964 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-600f8552-a2bc-4c89-a84c-04f1229436ed tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:43.919127 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-600f8552-a2bc-4c89-a84c-04f1229436ed tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:43.931165 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-600f8552-a2bc-4c89-a84c-04f1229436ed tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:44.049751 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-600f8552-a2bc-4c89-a84c-04f1229436ed tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f5aba8355c436b94508156bca24ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf39ecb69ea7474d940ad17f8bab4874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:07:44.073338 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-600f8552-a2bc-4c89-a84c-04f1229436ed tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/7a805bc0-29bf-4ca0-80b2-e2ee71912d51" status: 200 len: 1302 microversion: 2.1 time: 0.171246 Jun 16 19:07:44.075020 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 470/954] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:07:43 2022] GET /compute/v2.1/servers/7a805bc0-29bf-4ca0-80b2-e2ee71912d51 => generated 1302 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:07:45.095618 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-b3a98be1-660d-478a-86ec-ca603d0993e1 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:45.097185 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-b3a98be1-660d-478a-86ec-ca603d0993e1 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 7a805bc0-29bf-4ca0-80b2-e2ee71912d51] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:45.106220 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-b3a98be1-660d-478a-86ec-ca603d0993e1 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:45.107066 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-b3a98be1-660d-478a-86ec-ca603d0993e1 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:45.108243 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-b3a98be1-660d-478a-86ec-ca603d0993e1 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:45.108827 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-b3a98be1-660d-478a-86ec-ca603d0993e1 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:45.266593 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-b3a98be1-660d-478a-86ec-ca603d0993e1 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f5aba8355c436b94508156bca24ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf39ecb69ea7474d940ad17f8bab4874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:07:45.276677 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-b3a98be1-660d-478a-86ec-ca603d0993e1 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/7a805bc0-29bf-4ca0-80b2-e2ee71912d51" status: 200 len: 1367 microversion: 2.1 time: 0.188483 Jun 16 19:07:45.277577 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 485/955] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:07:45 2022] GET /compute/v2.1/servers/7a805bc0-29bf-4ca0-80b2-e2ee71912d51 => generated 1367 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:07:45.559698 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [req-08fc7045-f55d-4dad-855f-fd0f107c30ca req-fb0a2acb-4343-485a-9182-6f4ada676ff4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a805bc0-29bf-4ca0-80b2-e2ee71912d51", "tag": "b11cc78f-6579-4a83-bc49-5037445ba296"}]} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:07:45.572301 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-08fc7045-f55d-4dad-855f-fd0f107c30ca req-fb0a2acb-4343-485a-9182-6f4ada676ff4 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:45.572831 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-08fc7045-f55d-4dad-855f-fd0f107c30ca req-fb0a2acb-4343-485a-9182-6f4ada676ff4 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:45.588501 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.compute.server_external_events [req-08fc7045-f55d-4dad-855f-fd0f107c30ca req-fb0a2acb-4343-485a-9182-6f4ada676ff4 service nova] Creating event network-changed:b11cc78f-6579-4a83-bc49-5037445ba296 for instance 7a805bc0-29bf-4ca0-80b2-e2ee71912d51 on hv-cinder-84617 Jun 16 19:07:45.594898 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [req-08fc7045-f55d-4dad-855f-fd0f107c30ca req-fb0a2acb-4343-485a-9182-6f4ada676ff4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039816 Jun 16 19:07:45.595330 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 471/956] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:07:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:07:46.295151 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-aada33ab-3721-48bb-b182-8e7981135e22 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:46.295729 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-aada33ab-3721-48bb-b182-8e7981135e22 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 7a805bc0-29bf-4ca0-80b2-e2ee71912d51] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:46.302055 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-aada33ab-3721-48bb-b182-8e7981135e22 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:46.302478 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-aada33ab-3721-48bb-b182-8e7981135e22 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:46.303304 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-aada33ab-3721-48bb-b182-8e7981135e22 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:46.303737 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-aada33ab-3721-48bb-b182-8e7981135e22 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:46.446374 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-aada33ab-3721-48bb-b182-8e7981135e22 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f5aba8355c436b94508156bca24ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf39ecb69ea7474d940ad17f8bab4874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:07:46.455091 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-aada33ab-3721-48bb-b182-8e7981135e22 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/7a805bc0-29bf-4ca0-80b2-e2ee71912d51" status: 200 len: 1367 microversion: 2.1 time: 0.163901 Jun 16 19:07:46.455657 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 486/957] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:07:46 2022] GET /compute/v2.1/servers/7a805bc0-29bf-4ca0-80b2-e2ee71912d51 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:07:47.474337 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-2cc4b66d-54c7-4f1e-a8b2-d37b9921d63e tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:47.475129 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-2cc4b66d-54c7-4f1e-a8b2-d37b9921d63e tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 7a805bc0-29bf-4ca0-80b2-e2ee71912d51] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:47.481633 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-2cc4b66d-54c7-4f1e-a8b2-d37b9921d63e tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:47.482178 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-2cc4b66d-54c7-4f1e-a8b2-d37b9921d63e tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:47.483138 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-2cc4b66d-54c7-4f1e-a8b2-d37b9921d63e tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:47.483640 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-2cc4b66d-54c7-4f1e-a8b2-d37b9921d63e tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:47.623558 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-2cc4b66d-54c7-4f1e-a8b2-d37b9921d63e tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f5aba8355c436b94508156bca24ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf39ecb69ea7474d940ad17f8bab4874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:07:47.630928 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-2cc4b66d-54c7-4f1e-a8b2-d37b9921d63e tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/7a805bc0-29bf-4ca0-80b2-e2ee71912d51" status: 200 len: 1367 microversion: 2.1 time: 0.161542 Jun 16 19:07:47.631497 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 472/958] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:07:47 2022] GET /compute/v2.1/servers/7a805bc0-29bf-4ca0-80b2-e2ee71912d51 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:07:48.648891 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-4491b751-9311-473a-9029-9fd34eb55e09 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:48.649785 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-4491b751-9311-473a-9029-9fd34eb55e09 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 7a805bc0-29bf-4ca0-80b2-e2ee71912d51] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:48.656740 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-4491b751-9311-473a-9029-9fd34eb55e09 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:48.657188 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-4491b751-9311-473a-9029-9fd34eb55e09 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:48.657958 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-4491b751-9311-473a-9029-9fd34eb55e09 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:48.658389 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-4491b751-9311-473a-9029-9fd34eb55e09 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:48.803527 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-4491b751-9311-473a-9029-9fd34eb55e09 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f5aba8355c436b94508156bca24ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf39ecb69ea7474d940ad17f8bab4874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:07:48.812840 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-4491b751-9311-473a-9029-9fd34eb55e09 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/7a805bc0-29bf-4ca0-80b2-e2ee71912d51" status: 200 len: 1367 microversion: 2.1 time: 0.167704 Jun 16 19:07:48.813452 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 487/959] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:07:48 2022] GET /compute/v2.1/servers/7a805bc0-29bf-4ca0-80b2-e2ee71912d51 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:07:49.830985 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-28542f8c-48b4-4992-9b18-cf9052c585c7 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:49.832544 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-28542f8c-48b4-4992-9b18-cf9052c585c7 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 7a805bc0-29bf-4ca0-80b2-e2ee71912d51] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:49.841525 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-28542f8c-48b4-4992-9b18-cf9052c585c7 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:49.842086 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-28542f8c-48b4-4992-9b18-cf9052c585c7 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:49.843036 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-28542f8c-48b4-4992-9b18-cf9052c585c7 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:49.843735 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-28542f8c-48b4-4992-9b18-cf9052c585c7 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:50.060097 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-28542f8c-48b4-4992-9b18-cf9052c585c7 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f5aba8355c436b94508156bca24ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf39ecb69ea7474d940ad17f8bab4874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:07:50.067560 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-28542f8c-48b4-4992-9b18-cf9052c585c7 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/7a805bc0-29bf-4ca0-80b2-e2ee71912d51" status: 200 len: 1367 microversion: 2.1 time: 0.241588 Jun 16 19:07:50.068105 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 473/960] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:07:49 2022] GET /compute/v2.1/servers/7a805bc0-29bf-4ca0-80b2-e2ee71912d51 => generated 1367 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:07:51.084947 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-f44a04cb-4b02-4ec8-8a6d-412eaa042228 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:51.085562 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-f44a04cb-4b02-4ec8-8a6d-412eaa042228 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 7a805bc0-29bf-4ca0-80b2-e2ee71912d51] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:51.092880 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f44a04cb-4b02-4ec8-8a6d-412eaa042228 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:51.093334 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f44a04cb-4b02-4ec8-8a6d-412eaa042228 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:51.094099 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f44a04cb-4b02-4ec8-8a6d-412eaa042228 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:51.094541 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f44a04cb-4b02-4ec8-8a6d-412eaa042228 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:51.222369 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-f44a04cb-4b02-4ec8-8a6d-412eaa042228 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f5aba8355c436b94508156bca24ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf39ecb69ea7474d940ad17f8bab4874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:07:51.229883 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-f44a04cb-4b02-4ec8-8a6d-412eaa042228 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/7a805bc0-29bf-4ca0-80b2-e2ee71912d51" status: 200 len: 1367 microversion: 2.1 time: 0.148921 Jun 16 19:07:51.230446 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 488/961] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:07:51 2022] GET /compute/v2.1/servers/7a805bc0-29bf-4ca0-80b2-e2ee71912d51 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:07:52.247645 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-c9490ccb-65ae-4c57-b762-5207504a00c0 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:52.248258 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-c9490ccb-65ae-4c57-b762-5207504a00c0 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 7a805bc0-29bf-4ca0-80b2-e2ee71912d51] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:52.254849 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-c9490ccb-65ae-4c57-b762-5207504a00c0 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:52.255308 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-c9490ccb-65ae-4c57-b762-5207504a00c0 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:52.256078 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-c9490ccb-65ae-4c57-b762-5207504a00c0 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:52.256519 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-c9490ccb-65ae-4c57-b762-5207504a00c0 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:52.388263 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-c9490ccb-65ae-4c57-b762-5207504a00c0 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f5aba8355c436b94508156bca24ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf39ecb69ea7474d940ad17f8bab4874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:07:52.396143 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-c9490ccb-65ae-4c57-b762-5207504a00c0 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/7a805bc0-29bf-4ca0-80b2-e2ee71912d51" status: 200 len: 1367 microversion: 2.1 time: 0.152881 Jun 16 19:07:52.396779 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 474/962] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:07:52 2022] GET /compute/v2.1/servers/7a805bc0-29bf-4ca0-80b2-e2ee71912d51 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:07:52.869084 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-d27caada-c897-459f-82c2-88a8ef44db26 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1115643812", "imageRef": "1d993e69-7f01-4fe0-ba52-0eae2fa43ddf", "flavorRef": "452", "networks": [{"uuid": "a4ead1e7-3691-400b-ab98-1ae7122f29fc"}]}} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:07:52.887568 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_cell0:SELECT=6 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:07:52.925755 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.network.neutron [None req-d27caada-c897-459f-82c2-88a8ef44db26 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] validate_networks() for [('a4ead1e7-3691-400b-ab98-1ae7122f29fc', None, None, None, None, None)] {{(pid=117852) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:07:53.051564 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-830ad3b9-4005-444b-88bb-ca5321b15685 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-458793780", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-550046181", "security_groups": [{"name": "tempest-secgroup-smoke-1355388580"}], "block_device_mapping_v2": [{"uuid": "28731f23-7fba-4794-a06e-1539862f204f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "11bba4c6-eed3-44ef-bcb5-8b60426f2332"}]}} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:07:53.060431 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_cell0:SELECT=2 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:07:53.061124 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_cell0:SELECT=6 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:07:53.170677 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.network.neutron [None req-830ad3b9-4005-444b-88bb-ca5321b15685 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] validate_networks() for [('11bba4c6-eed3-44ef-bcb5-8b60426f2332', None, None, None, None, None)] {{(pid=117850) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:07:53.291612 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.virt.hardware [None req-d27caada-c897-459f-82c2-88a8ef44db26 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Flavor limits 0:0:0 {{(pid=117852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:07:53.292043 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.virt.hardware [None req-d27caada-c897-459f-82c2-88a8ef44db26 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Image limits 0:0:0 {{(pid=117852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:07:53.292514 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.virt.hardware [None req-d27caada-c897-459f-82c2-88a8ef44db26 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Flavor pref 0:0:0 {{(pid=117852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:07:53.292929 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.virt.hardware [None req-d27caada-c897-459f-82c2-88a8ef44db26 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Image pref 0:0:0 {{(pid=117852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:07:53.293519 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.virt.hardware [None req-d27caada-c897-459f-82c2-88a8ef44db26 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:07:53.295708 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:07:53.304675 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d27caada-c897-459f-82c2-88a8ef44db26 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:53.304879 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d27caada-c897-459f-82c2-88a8ef44db26 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:53.305929 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d27caada-c897-459f-82c2-88a8ef44db26 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:53.306368 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d27caada-c897-459f-82c2-88a8ef44db26 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:53.325160 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.quota [None req-d27caada-c897-459f-82c2-88a8ef44db26 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Getting quotas for project 8ee28f39049846188135a087b194d247. Resources: {'cores', 'ram', 'instances'} {{(pid=117852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:07:53.329806 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.quota [None req-d27caada-c897-459f-82c2-88a8ef44db26 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Getting quotas for user 4fc47b0b30344863af004541d777915b and project 8ee28f39049846188135a087b194d247. Resources: {'cores', 'ram', 'instances'} {{(pid=117852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:07:53.342333 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-d27caada-c897-459f-82c2-88a8ef44db26 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Going to run 1 instances... {{(pid=117852) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:07:53.344907 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-d27caada-c897-459f-82c2-88a8ef44db26 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] [instance: f4f48d71-846f-4e9a-8d3e-8e098aa3fa48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1d993e69-7f01-4fe0-ba52-0eae2fa43ddf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117852) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:07:53.394003 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-d27caada-c897-459f-82c2-88a8ef44db26 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.528755 Jun 16 19:07:53.394745 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 489/963] 10.222.0.70 () {60 vars in 1146 bytes} [Thu Jun 16 19:07:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 530 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:07:53.405684 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-6f70c3a1-cd54-43c1-9e1b-7ed962aa44a9 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:53.406398 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-6f70c3a1-cd54-43c1-9e1b-7ed962aa44a9 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] [instance: f4f48d71-846f-4e9a-8d3e-8e098aa3fa48] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:53.466389 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-6f70c3a1-cd54-43c1-9e1b-7ed962aa44a9 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc47b0b30344863af004541d777915b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee28f39049846188135a087b194d247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:07:53.474150 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-6f70c3a1-cd54-43c1-9e1b-7ed962aa44a9 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] 10.222.0.70 "GET /compute/v2.1/servers/f4f48d71-846f-4e9a-8d3e-8e098aa3fa48" status: 200 len: 1214 microversion: 2.1 time: 0.073070 Jun 16 19:07:53.484353 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 490/964] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:07:53 2022] GET /compute/v2.1/servers/f4f48d71-846f-4e9a-8d3e-8e098aa3fa48 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:07:53.489896 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-432b7b4c-2017-4207-98e7-bd10a094c60d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:53.490514 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-432b7b4c-2017-4207-98e7-bd10a094c60d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 7a805bc0-29bf-4ca0-80b2-e2ee71912d51] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:53.497712 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-432b7b4c-2017-4207-98e7-bd10a094c60d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:53.498205 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-432b7b4c-2017-4207-98e7-bd10a094c60d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:53.499164 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-432b7b4c-2017-4207-98e7-bd10a094c60d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:53.499939 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-432b7b4c-2017-4207-98e7-bd10a094c60d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:53.678433 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-830ad3b9-4005-444b-88bb-ca5321b15685 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Flavor limits 0:0:0 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:07:53.678985 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-830ad3b9-4005-444b-88bb-ca5321b15685 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Image limits 0:0:0 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:07:53.680115 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-830ad3b9-4005-444b-88bb-ca5321b15685 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Flavor pref 0:0:0 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:07:53.680569 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-830ad3b9-4005-444b-88bb-ca5321b15685 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Image pref 0:0:0 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:07:53.681086 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-830ad3b9-4005-444b-88bb-ca5321b15685 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:07:53.690506 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-432b7b4c-2017-4207-98e7-bd10a094c60d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f5aba8355c436b94508156bca24ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf39ecb69ea7474d940ad17f8bab4874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:07:53.691881 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-830ad3b9-4005-444b-88bb-ca5321b15685 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:53.692389 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-830ad3b9-4005-444b-88bb-ca5321b15685 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:53.693534 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-830ad3b9-4005-444b-88bb-ca5321b15685 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:53.693986 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-830ad3b9-4005-444b-88bb-ca5321b15685 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:53.698098 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-432b7b4c-2017-4207-98e7-bd10a094c60d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/7a805bc0-29bf-4ca0-80b2-e2ee71912d51" status: 200 len: 1367 microversion: 2.1 time: 0.212670 Jun 16 19:07:53.699005 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 491/965] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:07:53 2022] GET /compute/v2.1/servers/7a805bc0-29bf-4ca0-80b2-e2ee71912d51 => generated 1367 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:07:53.716261 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.quota [None req-830ad3b9-4005-444b-88bb-ca5321b15685 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Getting quotas for project 0e52189be8d24c9894ef05cc7acf367c. Resources: {'cores', 'ram', 'instances'} {{(pid=117850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:07:53.720923 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.quota [None req-830ad3b9-4005-444b-88bb-ca5321b15685 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Getting quotas for user 922a970a740444a2959c6aa1d0921ee7 and project 0e52189be8d24c9894ef05cc7acf367c. Resources: {'cores', 'ram', 'instances'} {{(pid=117850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:07:53.798967 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-830ad3b9-4005-444b-88bb-ca5321b15685 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Going to run 1 instances... {{(pid=117850) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:07:53.801061 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-830ad3b9-4005-444b-88bb-ca5321b15685 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: 312b94f9-6264-4dc8-81d3-c5d966852f12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='28731f23-7fba-4794-a06e-1539862f204f',volume_size=None,volume_type=None)] {{(pid=117850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:07:53.973750 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-830ad3b9-4005-444b-88bb-ca5321b15685 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.925930 Jun 16 19:07:53.974785 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 475/966] 10.222.0.70 () {60 vars in 1146 bytes} [Thu Jun 16 19:07:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 928 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 19:07:53.986252 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-4d6cd87a-3749-4830-9168-cd77ba281b49 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:53.986889 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-4d6cd87a-3749-4830-9168-cd77ba281b49 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: 312b94f9-6264-4dc8-81d3-c5d966852f12] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:54.058465 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-4d6cd87a-3749-4830-9168-cd77ba281b49 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:07:54.065870 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-4d6cd87a-3749-4830-9168-cd77ba281b49 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/312b94f9-6264-4dc8-81d3-c5d966852f12" status: 200 len: 1093 microversion: 2.1 time: 0.083585 Jun 16 19:07:54.066831 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 492/967] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:07:53 2022] GET /compute/v2.1/servers/312b94f9-6264-4dc8-81d3-c5d966852f12 => generated 1093 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:07:54.494184 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-955fc427-1d18-41d6-a3bc-53611a3b4ddf tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:54.495289 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-955fc427-1d18-41d6-a3bc-53611a3b4ddf tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] [instance: f4f48d71-846f-4e9a-8d3e-8e098aa3fa48] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:54.503860 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-955fc427-1d18-41d6-a3bc-53611a3b4ddf tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:54.504390 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-955fc427-1d18-41d6-a3bc-53611a3b4ddf tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:54.505796 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-955fc427-1d18-41d6-a3bc-53611a3b4ddf tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:54.506314 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-955fc427-1d18-41d6-a3bc-53611a3b4ddf tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:54.608603 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-955fc427-1d18-41d6-a3bc-53611a3b4ddf tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc47b0b30344863af004541d777915b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee28f39049846188135a087b194d247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:07:54.619367 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-955fc427-1d18-41d6-a3bc-53611a3b4ddf tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] 10.222.0.70 "GET /compute/v2.1/servers/f4f48d71-846f-4e9a-8d3e-8e098aa3fa48" status: 200 len: 1274 microversion: 2.1 time: 0.132833 Jun 16 19:07:54.620933 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 476/968] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:07:54 2022] GET /compute/v2.1/servers/f4f48d71-846f-4e9a-8d3e-8e098aa3fa48 => generated 1274 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:07:54.718496 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-a506e036-4c0d-4a16-9af2-94490682ad1c tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:54.720123 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-a506e036-4c0d-4a16-9af2-94490682ad1c tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 7a805bc0-29bf-4ca0-80b2-e2ee71912d51] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:54.731091 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-a506e036-4c0d-4a16-9af2-94490682ad1c tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:54.731670 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-a506e036-4c0d-4a16-9af2-94490682ad1c tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:54.732714 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-a506e036-4c0d-4a16-9af2-94490682ad1c tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:54.733383 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-a506e036-4c0d-4a16-9af2-94490682ad1c tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:54.890095 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-a506e036-4c0d-4a16-9af2-94490682ad1c tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f5aba8355c436b94508156bca24ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf39ecb69ea7474d940ad17f8bab4874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:07:54.898454 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-a506e036-4c0d-4a16-9af2-94490682ad1c tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/7a805bc0-29bf-4ca0-80b2-e2ee71912d51" status: 200 len: 1367 microversion: 2.1 time: 0.186119 Jun 16 19:07:54.899063 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 493/969] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:07:54 2022] GET /compute/v2.1/servers/7a805bc0-29bf-4ca0-80b2-e2ee71912d51 => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:07:55.084798 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-1c1ed323-140b-42e4-856f-801c0e056c81 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:55.085329 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-1c1ed323-140b-42e4-856f-801c0e056c81 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: 312b94f9-6264-4dc8-81d3-c5d966852f12] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:55.096476 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-1c1ed323-140b-42e4-856f-801c0e056c81 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:55.096939 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-1c1ed323-140b-42e4-856f-801c0e056c81 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:55.097736 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-1c1ed323-140b-42e4-856f-801c0e056c81 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:55.098315 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-1c1ed323-140b-42e4-856f-801c0e056c81 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:55.233340 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-1c1ed323-140b-42e4-856f-801c0e056c81 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:07:55.241051 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-1c1ed323-140b-42e4-856f-801c0e056c81 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/312b94f9-6264-4dc8-81d3-c5d966852f12" status: 200 len: 1199 microversion: 2.1 time: 0.160224 Jun 16 19:07:55.241628 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 477/970] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:07:55 2022] GET /compute/v2.1/servers/312b94f9-6264-4dc8-81d3-c5d966852f12 => generated 1199 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:07:55.489093 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [req-4d934bb0-7dad-40a3-bb0d-303d7dd6476c req-cb56a7ea-3762-4084-a408-f4dae373b7e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a805bc0-29bf-4ca0-80b2-e2ee71912d51", "name": "network-vif-plugged", "status": "completed", "tag": "b11cc78f-6579-4a83-bc49-5037445ba296"}]} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:07:55.501251 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-4d934bb0-7dad-40a3-bb0d-303d7dd6476c req-cb56a7ea-3762-4084-a408-f4dae373b7e6 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:55.501698 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-4d934bb0-7dad-40a3-bb0d-303d7dd6476c req-cb56a7ea-3762-4084-a408-f4dae373b7e6 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:55.514915 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.compute.server_external_events [req-4d934bb0-7dad-40a3-bb0d-303d7dd6476c req-cb56a7ea-3762-4084-a408-f4dae373b7e6 service nova] Creating event network-vif-plugged:b11cc78f-6579-4a83-bc49-5037445ba296 for instance 7a805bc0-29bf-4ca0-80b2-e2ee71912d51 on hv-cinder-84617 Jun 16 19:07:55.520327 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [req-4d934bb0-7dad-40a3-bb0d-303d7dd6476c req-cb56a7ea-3762-4084-a408-f4dae373b7e6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037578 Jun 16 19:07:55.521157 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 494/971] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:07:55.637849 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-d1131645-6047-47f8-bf54-5bd3cc93295b tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:55.638773 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-d1131645-6047-47f8-bf54-5bd3cc93295b tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] [instance: f4f48d71-846f-4e9a-8d3e-8e098aa3fa48] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:55.645947 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d1131645-6047-47f8-bf54-5bd3cc93295b tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:55.646662 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d1131645-6047-47f8-bf54-5bd3cc93295b tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:55.647659 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d1131645-6047-47f8-bf54-5bd3cc93295b tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:55.648122 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d1131645-6047-47f8-bf54-5bd3cc93295b tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:55.917607 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-7db54fbc-65b7-4fb3-9f0d-e3a2c302c7fd tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:55.918250 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-7db54fbc-65b7-4fb3-9f0d-e3a2c302c7fd tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 7a805bc0-29bf-4ca0-80b2-e2ee71912d51] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:55.924502 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-7db54fbc-65b7-4fb3-9f0d-e3a2c302c7fd tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:55.924962 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-7db54fbc-65b7-4fb3-9f0d-e3a2c302c7fd tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:55.925741 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-7db54fbc-65b7-4fb3-9f0d-e3a2c302c7fd tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:55.926841 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-7db54fbc-65b7-4fb3-9f0d-e3a2c302c7fd tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:56.044920 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-d1131645-6047-47f8-bf54-5bd3cc93295b tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc47b0b30344863af004541d777915b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee28f39049846188135a087b194d247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:07:56.056707 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-d1131645-6047-47f8-bf54-5bd3cc93295b tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] 10.222.0.70 "GET /compute/v2.1/servers/f4f48d71-846f-4e9a-8d3e-8e098aa3fa48" status: 200 len: 1314 microversion: 2.1 time: 0.422915 Jun 16 19:07:56.058123 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 478/972] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:07:55 2022] GET /compute/v2.1/servers/f4f48d71-846f-4e9a-8d3e-8e098aa3fa48 => generated 1314 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:07:56.079392 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-7db54fbc-65b7-4fb3-9f0d-e3a2c302c7fd tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f5aba8355c436b94508156bca24ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf39ecb69ea7474d940ad17f8bab4874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:07:56.087028 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-7db54fbc-65b7-4fb3-9f0d-e3a2c302c7fd tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/7a805bc0-29bf-4ca0-80b2-e2ee71912d51" status: 200 len: 1367 microversion: 2.1 time: 0.173865 Jun 16 19:07:56.087813 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 495/973] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:07:55 2022] GET /compute/v2.1/servers/7a805bc0-29bf-4ca0-80b2-e2ee71912d51 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:07:56.258697 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-f86d1960-bd7d-4c4f-8a6c-b77b1db6c6b1 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:56.259616 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-f86d1960-bd7d-4c4f-8a6c-b77b1db6c6b1 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: 312b94f9-6264-4dc8-81d3-c5d966852f12] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:56.267191 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-f86d1960-bd7d-4c4f-8a6c-b77b1db6c6b1 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:56.267650 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-f86d1960-bd7d-4c4f-8a6c-b77b1db6c6b1 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:56.268432 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-f86d1960-bd7d-4c4f-8a6c-b77b1db6c6b1 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:56.268878 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-f86d1960-bd7d-4c4f-8a6c-b77b1db6c6b1 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:56.358144 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-f86d1960-bd7d-4c4f-8a6c-b77b1db6c6b1 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:07:56.366140 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-f86d1960-bd7d-4c4f-8a6c-b77b1db6c6b1 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/312b94f9-6264-4dc8-81d3-c5d966852f12" status: 200 len: 1197 microversion: 2.1 time: 0.111765 Jun 16 19:07:56.367129 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 479/974] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:07:56 2022] GET /compute/v2.1/servers/312b94f9-6264-4dc8-81d3-c5d966852f12 => generated 1197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:07:56.879950 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [req-8c41cdc7-855b-4688-9088-78a2d2c20a03 req-f3c3d841-c552-4c29-a6c5-9e00331da073 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4f48d71-846f-4e9a-8d3e-8e098aa3fa48", "tag": "5f6b0f24-a011-43dd-9041-0303f1759fc0"}]} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:07:56.889744 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-8c41cdc7-855b-4688-9088-78a2d2c20a03 req-f3c3d841-c552-4c29-a6c5-9e00331da073 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:56.890199 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-8c41cdc7-855b-4688-9088-78a2d2c20a03 req-f3c3d841-c552-4c29-a6c5-9e00331da073 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:56.901391 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.compute.server_external_events [req-8c41cdc7-855b-4688-9088-78a2d2c20a03 req-f3c3d841-c552-4c29-a6c5-9e00331da073 service nova] Creating event network-changed:5f6b0f24-a011-43dd-9041-0303f1759fc0 for instance f4f48d71-846f-4e9a-8d3e-8e098aa3fa48 on hv-cinder-84617 Jun 16 19:07:56.907212 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [req-8c41cdc7-855b-4688-9088-78a2d2c20a03 req-f3c3d841-c552-4c29-a6c5-9e00331da073 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030902 Jun 16 19:07:56.907806 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 496/975] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:07:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:07:57.076367 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-ba7d210e-22ce-4f1a-bde5-70446f63028a tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:57.076983 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-ba7d210e-22ce-4f1a-bde5-70446f63028a tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] [instance: f4f48d71-846f-4e9a-8d3e-8e098aa3fa48] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:57.083493 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-ba7d210e-22ce-4f1a-bde5-70446f63028a tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:57.083946 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-ba7d210e-22ce-4f1a-bde5-70446f63028a tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:57.084719 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-ba7d210e-22ce-4f1a-bde5-70446f63028a tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:57.085160 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-ba7d210e-22ce-4f1a-bde5-70446f63028a tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:57.105898 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-89e68177-b4a0-41bb-9d88-324d565ca0b7 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:57.107043 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-89e68177-b4a0-41bb-9d88-324d565ca0b7 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 7a805bc0-29bf-4ca0-80b2-e2ee71912d51] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:57.113982 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-89e68177-b4a0-41bb-9d88-324d565ca0b7 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:57.114432 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-89e68177-b4a0-41bb-9d88-324d565ca0b7 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:57.115405 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-89e68177-b4a0-41bb-9d88-324d565ca0b7 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:57.115838 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-89e68177-b4a0-41bb-9d88-324d565ca0b7 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:57.260961 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-89e68177-b4a0-41bb-9d88-324d565ca0b7 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f5aba8355c436b94508156bca24ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf39ecb69ea7474d940ad17f8bab4874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:07:57.280518 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-89e68177-b4a0-41bb-9d88-324d565ca0b7 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/7a805bc0-29bf-4ca0-80b2-e2ee71912d51" status: 200 len: 1367 microversion: 2.1 time: 0.178959 Jun 16 19:07:57.281102 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 497/976] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:07:57 2022] GET /compute/v2.1/servers/7a805bc0-29bf-4ca0-80b2-e2ee71912d51 => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:07:57.359425 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-ba7d210e-22ce-4f1a-bde5-70446f63028a tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc47b0b30344863af004541d777915b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee28f39049846188135a087b194d247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:07:57.372072 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-ba7d210e-22ce-4f1a-bde5-70446f63028a tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] 10.222.0.70 "GET /compute/v2.1/servers/f4f48d71-846f-4e9a-8d3e-8e098aa3fa48" status: 200 len: 1314 microversion: 2.1 time: 0.299354 Jun 16 19:07:57.373157 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 480/977] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:07:57 2022] GET /compute/v2.1/servers/f4f48d71-846f-4e9a-8d3e-8e098aa3fa48 => generated 1314 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:07:57.389506 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-b9944b30-6803-4fa0-944d-6f3953273c93 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:57.390464 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-b9944b30-6803-4fa0-944d-6f3953273c93 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: 312b94f9-6264-4dc8-81d3-c5d966852f12] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:57.397325 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-b9944b30-6803-4fa0-944d-6f3953273c93 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:57.397775 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-b9944b30-6803-4fa0-944d-6f3953273c93 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:57.398618 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-b9944b30-6803-4fa0-944d-6f3953273c93 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:57.399059 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-b9944b30-6803-4fa0-944d-6f3953273c93 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:57.544993 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-b9944b30-6803-4fa0-944d-6f3953273c93 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:07:57.552953 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-b9944b30-6803-4fa0-944d-6f3953273c93 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/312b94f9-6264-4dc8-81d3-c5d966852f12" status: 200 len: 1265 microversion: 2.1 time: 0.168295 Jun 16 19:07:57.553555 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 498/978] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:07:57 2022] GET /compute/v2.1/servers/312b94f9-6264-4dc8-81d3-c5d966852f12 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:07:58.298410 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-12af3210-89a7-4a63-a1e0-56af61bc2435 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:58.299098 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-12af3210-89a7-4a63-a1e0-56af61bc2435 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 7a805bc0-29bf-4ca0-80b2-e2ee71912d51] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:58.305919 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-12af3210-89a7-4a63-a1e0-56af61bc2435 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:58.306377 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-12af3210-89a7-4a63-a1e0-56af61bc2435 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:58.307199 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-12af3210-89a7-4a63-a1e0-56af61bc2435 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:58.307642 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-12af3210-89a7-4a63-a1e0-56af61bc2435 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:58.390289 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-edc7a7e3-1727-471d-9990-14a10783e219 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:58.390874 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-edc7a7e3-1727-471d-9990-14a10783e219 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] [instance: f4f48d71-846f-4e9a-8d3e-8e098aa3fa48] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:58.397600 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-edc7a7e3-1727-471d-9990-14a10783e219 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:58.398048 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-edc7a7e3-1727-471d-9990-14a10783e219 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:58.398925 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-edc7a7e3-1727-471d-9990-14a10783e219 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:58.399613 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-edc7a7e3-1727-471d-9990-14a10783e219 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:58.545526 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-edc7a7e3-1727-471d-9990-14a10783e219 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc47b0b30344863af004541d777915b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee28f39049846188135a087b194d247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:07:58.553036 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-edc7a7e3-1727-471d-9990-14a10783e219 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] 10.222.0.70 "GET /compute/v2.1/servers/f4f48d71-846f-4e9a-8d3e-8e098aa3fa48" status: 200 len: 1314 microversion: 2.1 time: 0.167551 Jun 16 19:07:58.553603 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 499/979] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:07:58 2022] GET /compute/v2.1/servers/f4f48d71-846f-4e9a-8d3e-8e098aa3fa48 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:07:58.570851 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-751128ac-9d1c-43e2-bb4e-7636d5d22298 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:58.571466 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-751128ac-9d1c-43e2-bb4e-7636d5d22298 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: 312b94f9-6264-4dc8-81d3-c5d966852f12] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:58.578119 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-751128ac-9d1c-43e2-bb4e-7636d5d22298 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:58.578544 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-751128ac-9d1c-43e2-bb4e-7636d5d22298 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:58.579371 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-751128ac-9d1c-43e2-bb4e-7636d5d22298 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:58.579804 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-751128ac-9d1c-43e2-bb4e-7636d5d22298 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:58.712930 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-751128ac-9d1c-43e2-bb4e-7636d5d22298 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:07:58.721613 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-751128ac-9d1c-43e2-bb4e-7636d5d22298 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/312b94f9-6264-4dc8-81d3-c5d966852f12" status: 200 len: 1265 microversion: 2.1 time: 0.154936 Jun 16 19:07:58.722245 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 500/980] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:07:58 2022] GET /compute/v2.1/servers/312b94f9-6264-4dc8-81d3-c5d966852f12 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:07:58.734558 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-12af3210-89a7-4a63-a1e0-56af61bc2435 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f5aba8355c436b94508156bca24ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf39ecb69ea7474d940ad17f8bab4874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:07:58.743097 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-12af3210-89a7-4a63-a1e0-56af61bc2435 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/7a805bc0-29bf-4ca0-80b2-e2ee71912d51" status: 200 len: 1556 microversion: 2.1 time: 0.448789 Jun 16 19:07:58.743674 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 481/981] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:07:58 2022] GET /compute/v2.1/servers/7a805bc0-29bf-4ca0-80b2-e2ee71912d51 => generated 1556 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:07:58.760388 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-db19ae2a-b100-4c1b-af95-74012fd57f84 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:58.760916 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-db19ae2a-b100-4c1b-af95-74012fd57f84 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 7a805bc0-29bf-4ca0-80b2-e2ee71912d51] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:58.768635 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-db19ae2a-b100-4c1b-af95-74012fd57f84 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:58.769104 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-db19ae2a-b100-4c1b-af95-74012fd57f84 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:58.770238 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-db19ae2a-b100-4c1b-af95-74012fd57f84 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:58.770732 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-db19ae2a-b100-4c1b-af95-74012fd57f84 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:58.854128 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-db19ae2a-b100-4c1b-af95-74012fd57f84 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/7a805bc0-29bf-4ca0-80b2-e2ee71912d51/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097554 Jun 16 19:07:58.854747 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 501/982] 10.222.0.70 () {58 vars in 1274 bytes} [Thu Jun 16 19:07:58 2022] GET /compute/v2.1/servers/7a805bc0-29bf-4ca0-80b2-e2ee71912d51/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:07:58.924840 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [req-19707f6f-092f-4435-b900-33fe98874654 req-8af470ff-dd5f-46e6-aad2-ce76c6800df7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "312b94f9-6264-4dc8-81d3-c5d966852f12", "tag": "0ff62f9c-41e5-451d-8042-badc5173ffd1"}]} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:07:58.932797 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-19707f6f-092f-4435-b900-33fe98874654 req-8af470ff-dd5f-46e6-aad2-ce76c6800df7 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:58.933240 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-19707f6f-092f-4435-b900-33fe98874654 req-8af470ff-dd5f-46e6-aad2-ce76c6800df7 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:58.951082 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.compute.server_external_events [req-19707f6f-092f-4435-b900-33fe98874654 req-8af470ff-dd5f-46e6-aad2-ce76c6800df7 service nova] Creating event network-changed:0ff62f9c-41e5-451d-8042-badc5173ffd1 for instance 312b94f9-6264-4dc8-81d3-c5d966852f12 on hv-cinder-84617 Jun 16 19:07:58.956683 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [req-19707f6f-092f-4435-b900-33fe98874654 req-8af470ff-dd5f-46e6-aad2-ce76c6800df7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035425 Jun 16 19:07:58.957566 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 482/983] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:07:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:07:59.571355 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-9f8b78a0-d690-4eee-979e-269aee2310ae tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:59.571973 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-9f8b78a0-d690-4eee-979e-269aee2310ae tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] [instance: f4f48d71-846f-4e9a-8d3e-8e098aa3fa48] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:59.579197 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-9f8b78a0-d690-4eee-979e-269aee2310ae tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:59.579650 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-9f8b78a0-d690-4eee-979e-269aee2310ae tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:59.580424 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-9f8b78a0-d690-4eee-979e-269aee2310ae tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:59.580864 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-9f8b78a0-d690-4eee-979e-269aee2310ae tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:59.738991 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-d69c7aaa-2f34-43ef-b460-1ee78de8c2b4 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:07:59.739802 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-d69c7aaa-2f34-43ef-b460-1ee78de8c2b4 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: 312b94f9-6264-4dc8-81d3-c5d966852f12] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:07:59.747415 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d69c7aaa-2f34-43ef-b460-1ee78de8c2b4 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:59.747875 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d69c7aaa-2f34-43ef-b460-1ee78de8c2b4 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:59.748765 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d69c7aaa-2f34-43ef-b460-1ee78de8c2b4 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:59.749459 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d69c7aaa-2f34-43ef-b460-1ee78de8c2b4 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:59.778085 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-9f8b78a0-d690-4eee-979e-269aee2310ae tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc47b0b30344863af004541d777915b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee28f39049846188135a087b194d247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:07:59.786931 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-9f8b78a0-d690-4eee-979e-269aee2310ae tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] 10.222.0.70 "GET /compute/v2.1/servers/f4f48d71-846f-4e9a-8d3e-8e098aa3fa48" status: 200 len: 1314 microversion: 2.1 time: 0.220011 Jun 16 19:07:59.787501 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 502/984] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:07:59 2022] GET /compute/v2.1/servers/f4f48d71-846f-4e9a-8d3e-8e098aa3fa48 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:07:59.885443 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [req-71954dbb-5efb-499b-aa5a-f1b7eb3508c3 req-4fa1658d-3b04-4a8b-be53-0e95c7142500 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a805bc0-29bf-4ca0-80b2-e2ee71912d51", "tag": "b11cc78f-6579-4a83-bc49-5037445ba296"}]} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:07:59.892577 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-d69c7aaa-2f34-43ef-b460-1ee78de8c2b4 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:07:59.895491 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-71954dbb-5efb-499b-aa5a-f1b7eb3508c3 req-4fa1658d-3b04-4a8b-be53-0e95c7142500 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:07:59.895940 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-71954dbb-5efb-499b-aa5a-f1b7eb3508c3 req-4fa1658d-3b04-4a8b-be53-0e95c7142500 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:07:59.900887 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-d69c7aaa-2f34-43ef-b460-1ee78de8c2b4 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/312b94f9-6264-4dc8-81d3-c5d966852f12" status: 200 len: 1265 microversion: 2.1 time: 0.166368 Jun 16 19:07:59.901785 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 483/985] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:07:59 2022] GET /compute/v2.1/servers/312b94f9-6264-4dc8-81d3-c5d966852f12 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:07:59.908029 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.compute.server_external_events [req-71954dbb-5efb-499b-aa5a-f1b7eb3508c3 req-4fa1658d-3b04-4a8b-be53-0e95c7142500 service nova] Creating event network-changed:b11cc78f-6579-4a83-bc49-5037445ba296 for instance 7a805bc0-29bf-4ca0-80b2-e2ee71912d51 on hv-cinder-84617 Jun 16 19:07:59.913044 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [req-71954dbb-5efb-499b-aa5a-f1b7eb3508c3 req-4fa1658d-3b04-4a8b-be53-0e95c7142500 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031284 Jun 16 19:07:59.913630 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 503/986] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:08:00.805420 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-27d78917-59a8-404a-940c-897fd55fd227 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:00.806539 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-27d78917-59a8-404a-940c-897fd55fd227 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] [instance: f4f48d71-846f-4e9a-8d3e-8e098aa3fa48] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:00.816109 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-27d78917-59a8-404a-940c-897fd55fd227 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:00.816563 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-27d78917-59a8-404a-940c-897fd55fd227 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:00.817544 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-27d78917-59a8-404a-940c-897fd55fd227 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:00.817981 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-27d78917-59a8-404a-940c-897fd55fd227 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:00.920185 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-009a0e5f-6616-4ce5-9be8-3fcd9e28ad1e tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:00.921512 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-009a0e5f-6616-4ce5-9be8-3fcd9e28ad1e tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: 312b94f9-6264-4dc8-81d3-c5d966852f12] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:00.928883 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-009a0e5f-6616-4ce5-9be8-3fcd9e28ad1e tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:00.929340 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-009a0e5f-6616-4ce5-9be8-3fcd9e28ad1e tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:00.930122 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-009a0e5f-6616-4ce5-9be8-3fcd9e28ad1e tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:00.930563 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-009a0e5f-6616-4ce5-9be8-3fcd9e28ad1e tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:01.049675 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-27d78917-59a8-404a-940c-897fd55fd227 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc47b0b30344863af004541d777915b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee28f39049846188135a087b194d247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:08:01.057272 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-27d78917-59a8-404a-940c-897fd55fd227 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] 10.222.0.70 "GET /compute/v2.1/servers/f4f48d71-846f-4e9a-8d3e-8e098aa3fa48" status: 200 len: 1314 microversion: 2.1 time: 0.257426 Jun 16 19:08:01.057852 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 484/987] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:00 2022] GET /compute/v2.1/servers/f4f48d71-846f-4e9a-8d3e-8e098aa3fa48 => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:08:01.079070 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-009a0e5f-6616-4ce5-9be8-3fcd9e28ad1e tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:08:01.087074 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-009a0e5f-6616-4ce5-9be8-3fcd9e28ad1e tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/312b94f9-6264-4dc8-81d3-c5d966852f12" status: 200 len: 1265 microversion: 2.1 time: 0.171763 Jun 16 19:08:01.087679 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 504/988] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:00 2022] GET /compute/v2.1/servers/312b94f9-6264-4dc8-81d3-c5d966852f12 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:08:02.073280 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-b4023874-e5ad-42de-b150-68c01c31374e tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:02.073891 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-b4023874-e5ad-42de-b150-68c01c31374e tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] [instance: f4f48d71-846f-4e9a-8d3e-8e098aa3fa48] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:02.082027 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b4023874-e5ad-42de-b150-68c01c31374e tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:02.082720 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b4023874-e5ad-42de-b150-68c01c31374e tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:02.083783 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b4023874-e5ad-42de-b150-68c01c31374e tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:02.084325 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b4023874-e5ad-42de-b150-68c01c31374e tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:02.104990 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-ca857747-2061-4612-85f6-426855f7d0bc tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:02.106120 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-ca857747-2061-4612-85f6-426855f7d0bc tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: 312b94f9-6264-4dc8-81d3-c5d966852f12] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:02.113888 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ca857747-2061-4612-85f6-426855f7d0bc tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:02.114338 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ca857747-2061-4612-85f6-426855f7d0bc tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:02.115170 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ca857747-2061-4612-85f6-426855f7d0bc tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:02.115608 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ca857747-2061-4612-85f6-426855f7d0bc tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:02.225306 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-b4023874-e5ad-42de-b150-68c01c31374e tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc47b0b30344863af004541d777915b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee28f39049846188135a087b194d247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:08:02.233705 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-b4023874-e5ad-42de-b150-68c01c31374e tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] 10.222.0.70 "GET /compute/v2.1/servers/f4f48d71-846f-4e9a-8d3e-8e098aa3fa48" status: 200 len: 1314 microversion: 2.1 time: 0.164231 Jun 16 19:08:02.234273 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 485/989] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:02 2022] GET /compute/v2.1/servers/f4f48d71-846f-4e9a-8d3e-8e098aa3fa48 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:08:02.251642 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-ca857747-2061-4612-85f6-426855f7d0bc tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:08:02.259162 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-ca857747-2061-4612-85f6-426855f7d0bc tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/312b94f9-6264-4dc8-81d3-c5d966852f12" status: 200 len: 1265 microversion: 2.1 time: 0.158116 Jun 16 19:08:02.259709 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 505/990] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:02 2022] GET /compute/v2.1/servers/312b94f9-6264-4dc8-81d3-c5d966852f12 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:08:03.251039 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-1e39edaf-fd55-4f44-92f7-43fa697c1a30 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:03.251973 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-1e39edaf-fd55-4f44-92f7-43fa697c1a30 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] [instance: f4f48d71-846f-4e9a-8d3e-8e098aa3fa48] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:03.258042 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-1e39edaf-fd55-4f44-92f7-43fa697c1a30 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:03.258487 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-1e39edaf-fd55-4f44-92f7-43fa697c1a30 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:03.259274 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-1e39edaf-fd55-4f44-92f7-43fa697c1a30 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:03.259706 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-1e39edaf-fd55-4f44-92f7-43fa697c1a30 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:03.280335 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-8c055b13-67a1-4317-9beb-8eb87b7a9202 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:03.281019 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-8c055b13-67a1-4317-9beb-8eb87b7a9202 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: 312b94f9-6264-4dc8-81d3-c5d966852f12] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:03.287319 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-8c055b13-67a1-4317-9beb-8eb87b7a9202 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:03.287766 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-8c055b13-67a1-4317-9beb-8eb87b7a9202 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:03.288527 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-8c055b13-67a1-4317-9beb-8eb87b7a9202 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:03.288966 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-8c055b13-67a1-4317-9beb-8eb87b7a9202 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:03.307913 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_cell1:SELECT=100 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:08:03.315008 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_cell0:SELECT=2 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:08:03.393205 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-1e39edaf-fd55-4f44-92f7-43fa697c1a30 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc47b0b30344863af004541d777915b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee28f39049846188135a087b194d247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:08:03.403237 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-1e39edaf-fd55-4f44-92f7-43fa697c1a30 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] 10.222.0.70 "GET /compute/v2.1/servers/f4f48d71-846f-4e9a-8d3e-8e098aa3fa48" status: 200 len: 1314 microversion: 2.1 time: 0.156433 Jun 16 19:08:03.404428 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 486/991] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:03 2022] GET /compute/v2.1/servers/f4f48d71-846f-4e9a-8d3e-8e098aa3fa48 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:08:03.434881 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-8c055b13-67a1-4317-9beb-8eb87b7a9202 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:08:03.442463 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-8c055b13-67a1-4317-9beb-8eb87b7a9202 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/312b94f9-6264-4dc8-81d3-c5d966852f12" status: 200 len: 1265 microversion: 2.1 time: 0.165938 Jun 16 19:08:03.443080 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 506/992] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:03 2022] GET /compute/v2.1/servers/312b94f9-6264-4dc8-81d3-c5d966852f12 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:08:03.521777 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [req-57d235f2-86de-40c7-8588-7b9878d75b6b req-77a242f9-dd70-4143-b265-52fafa7bd800 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4f48d71-846f-4e9a-8d3e-8e098aa3fa48", "name": "network-vif-plugged", "status": "completed", "tag": "5f6b0f24-a011-43dd-9041-0303f1759fc0"}]} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:08:03.531555 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-57d235f2-86de-40c7-8588-7b9878d75b6b req-77a242f9-dd70-4143-b265-52fafa7bd800 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:03.532102 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-57d235f2-86de-40c7-8588-7b9878d75b6b req-77a242f9-dd70-4143-b265-52fafa7bd800 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:03.544453 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.compute.server_external_events [req-57d235f2-86de-40c7-8588-7b9878d75b6b req-77a242f9-dd70-4143-b265-52fafa7bd800 service nova] Creating event network-vif-plugged:5f6b0f24-a011-43dd-9041-0303f1759fc0 for instance f4f48d71-846f-4e9a-8d3e-8e098aa3fa48 on hv-cinder-84617 Jun 16 19:08:03.549747 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [req-57d235f2-86de-40c7-8588-7b9878d75b6b req-77a242f9-dd70-4143-b265-52fafa7bd800 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031857 Jun 16 19:08:03.550497 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 487/993] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:08:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:08:04.420931 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-c1674cbf-921d-45df-9edb-6b543343f687 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:04.421576 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-c1674cbf-921d-45df-9edb-6b543343f687 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] [instance: f4f48d71-846f-4e9a-8d3e-8e098aa3fa48] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:04.423433 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_cell0:SELECT=10 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:08:04.429115 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-c1674cbf-921d-45df-9edb-6b543343f687 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:04.429568 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-c1674cbf-921d-45df-9edb-6b543343f687 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:04.430499 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-c1674cbf-921d-45df-9edb-6b543343f687 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:04.430977 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-c1674cbf-921d-45df-9edb-6b543343f687 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:04.457452 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_cell0:SELECT=2 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:08:04.458643 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_cell0:SELECT=6 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:08:04.463342 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-224b26f4-d3a0-4b13-89e9-7343a3ce51d6 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:04.464044 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-224b26f4-d3a0-4b13-89e9-7343a3ce51d6 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: 312b94f9-6264-4dc8-81d3-c5d966852f12] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:04.471403 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-224b26f4-d3a0-4b13-89e9-7343a3ce51d6 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:04.471883 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-224b26f4-d3a0-4b13-89e9-7343a3ce51d6 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:04.472615 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-224b26f4-d3a0-4b13-89e9-7343a3ce51d6 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:04.473052 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-224b26f4-d3a0-4b13-89e9-7343a3ce51d6 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:04.581890 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-c1674cbf-921d-45df-9edb-6b543343f687 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc47b0b30344863af004541d777915b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee28f39049846188135a087b194d247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:08:04.590267 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-c1674cbf-921d-45df-9edb-6b543343f687 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] 10.222.0.70 "GET /compute/v2.1/servers/f4f48d71-846f-4e9a-8d3e-8e098aa3fa48" status: 200 len: 1314 microversion: 2.1 time: 0.173271 Jun 16 19:08:04.596541 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 507/994] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:04 2022] GET /compute/v2.1/servers/f4f48d71-846f-4e9a-8d3e-8e098aa3fa48 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:08:04.610021 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-224b26f4-d3a0-4b13-89e9-7343a3ce51d6 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:08:04.613515 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_cell1:SELECT=100 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:08:04.618409 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-224b26f4-d3a0-4b13-89e9-7343a3ce51d6 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/312b94f9-6264-4dc8-81d3-c5d966852f12" status: 200 len: 1265 microversion: 2.1 time: 0.161848 Jun 16 19:08:04.619005 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 488/995] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:04 2022] GET /compute/v2.1/servers/312b94f9-6264-4dc8-81d3-c5d966852f12 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:08:05.607374 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-af25702e-271f-4bcd-ae0c-7e1e97362e9a tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:05.608123 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-af25702e-271f-4bcd-ae0c-7e1e97362e9a tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] [instance: f4f48d71-846f-4e9a-8d3e-8e098aa3fa48] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:05.615077 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-af25702e-271f-4bcd-ae0c-7e1e97362e9a tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:05.615526 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-af25702e-271f-4bcd-ae0c-7e1e97362e9a tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:05.616291 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-af25702e-271f-4bcd-ae0c-7e1e97362e9a tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:05.616736 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-af25702e-271f-4bcd-ae0c-7e1e97362e9a tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:05.636150 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-13bbf0f9-b399-46b7-8c9c-dc663925b9e5 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:05.637548 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-13bbf0f9-b399-46b7-8c9c-dc663925b9e5 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: 312b94f9-6264-4dc8-81d3-c5d966852f12] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:05.644432 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-13bbf0f9-b399-46b7-8c9c-dc663925b9e5 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:05.644996 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-13bbf0f9-b399-46b7-8c9c-dc663925b9e5 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:05.645778 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-13bbf0f9-b399-46b7-8c9c-dc663925b9e5 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:05.646222 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-13bbf0f9-b399-46b7-8c9c-dc663925b9e5 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:05.753088 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-af25702e-271f-4bcd-ae0c-7e1e97362e9a tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc47b0b30344863af004541d777915b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee28f39049846188135a087b194d247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:08:05.760511 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-af25702e-271f-4bcd-ae0c-7e1e97362e9a tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] 10.222.0.70 "GET /compute/v2.1/servers/f4f48d71-846f-4e9a-8d3e-8e098aa3fa48" status: 200 len: 1498 microversion: 2.1 time: 0.157219 Jun 16 19:08:05.761072 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 508/996] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:05 2022] GET /compute/v2.1/servers/f4f48d71-846f-4e9a-8d3e-8e098aa3fa48 => generated 1498 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:08:05.785473 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-13bbf0f9-b399-46b7-8c9c-dc663925b9e5 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:08:05.794026 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-13bbf0f9-b399-46b7-8c9c-dc663925b9e5 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/312b94f9-6264-4dc8-81d3-c5d966852f12" status: 200 len: 1265 microversion: 2.1 time: 0.160984 Jun 16 19:08:05.794319 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 489/997] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:05 2022] GET /compute/v2.1/servers/312b94f9-6264-4dc8-81d3-c5d966852f12 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:08:06.173000 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-416581b9-fac7-4dee-b15e-b6d133188343 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:06.173530 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-416581b9-fac7-4dee-b15e-b6d133188343 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] [instance: f4f48d71-846f-4e9a-8d3e-8e098aa3fa48] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:06.179498 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-416581b9-fac7-4dee-b15e-b6d133188343 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:06.179945 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-416581b9-fac7-4dee-b15e-b6d133188343 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:06.180749 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-416581b9-fac7-4dee-b15e-b6d133188343 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:06.181130 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-416581b9-fac7-4dee-b15e-b6d133188343 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:06.206581 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-416581b9-fac7-4dee-b15e-b6d133188343 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] [instance: f4f48d71-846f-4e9a-8d3e-8e098aa3fa48] Going to try to terminate instance {{(pid=117852) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:08:06.284009 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-416581b9-fac7-4dee-b15e-b6d133188343 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] 10.222.0.70 "DELETE /compute/v2.1/servers/f4f48d71-846f-4e9a-8d3e-8e098aa3fa48" status: 204 len: 0 microversion: 2.1 time: 0.114680 Jun 16 19:08:06.284760 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 509/998] 10.222.0.70 () {58 vars in 1238 bytes} [Thu Jun 16 19:08:06 2022] DELETE /compute/v2.1/servers/f4f48d71-846f-4e9a-8d3e-8e098aa3fa48 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:08:06.293337 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-3ca30b0e-24ca-4ebb-afbd-a69b060f7222 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:06.293963 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-3ca30b0e-24ca-4ebb-afbd-a69b060f7222 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] [instance: f4f48d71-846f-4e9a-8d3e-8e098aa3fa48] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:06.301091 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-3ca30b0e-24ca-4ebb-afbd-a69b060f7222 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:06.301550 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-3ca30b0e-24ca-4ebb-afbd-a69b060f7222 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:06.302324 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-3ca30b0e-24ca-4ebb-afbd-a69b060f7222 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:06.302839 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-3ca30b0e-24ca-4ebb-afbd-a69b060f7222 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:06.433329 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-3ca30b0e-24ca-4ebb-afbd-a69b060f7222 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc47b0b30344863af004541d777915b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee28f39049846188135a087b194d247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:08:06.441323 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-3ca30b0e-24ca-4ebb-afbd-a69b060f7222 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] 10.222.0.70 "GET /compute/v2.1/servers/f4f48d71-846f-4e9a-8d3e-8e098aa3fa48" status: 200 len: 1504 microversion: 2.1 time: 0.152215 Jun 16 19:08:06.441932 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 490/999] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:06 2022] GET /compute/v2.1/servers/f4f48d71-846f-4e9a-8d3e-8e098aa3fa48 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:08:06.812194 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-0acdd6b6-a15d-4297-8a01-7d92b399282f tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:06.812988 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-0acdd6b6-a15d-4297-8a01-7d92b399282f tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: 312b94f9-6264-4dc8-81d3-c5d966852f12] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:06.819477 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-0acdd6b6-a15d-4297-8a01-7d92b399282f tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:06.819928 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-0acdd6b6-a15d-4297-8a01-7d92b399282f tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:06.820691 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-0acdd6b6-a15d-4297-8a01-7d92b399282f tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:06.821131 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-0acdd6b6-a15d-4297-8a01-7d92b399282f tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:06.961914 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-0acdd6b6-a15d-4297-8a01-7d92b399282f tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:08:06.970608 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-0acdd6b6-a15d-4297-8a01-7d92b399282f tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/312b94f9-6264-4dc8-81d3-c5d966852f12" status: 200 len: 1265 microversion: 2.1 time: 0.163732 Jun 16 19:08:06.971172 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 510/1000] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:06 2022] GET /compute/v2.1/servers/312b94f9-6264-4dc8-81d3-c5d966852f12 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:08:07.459664 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-c1e065e9-6f3d-4649-9b37-7d29dca46c9f tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:07.460299 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-c1e065e9-6f3d-4649-9b37-7d29dca46c9f tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] [instance: f4f48d71-846f-4e9a-8d3e-8e098aa3fa48] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:07.467003 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-c1e065e9-6f3d-4649-9b37-7d29dca46c9f tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:07.467452 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-c1e065e9-6f3d-4649-9b37-7d29dca46c9f tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:07.468301 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-c1e065e9-6f3d-4649-9b37-7d29dca46c9f tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:07.468760 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-c1e065e9-6f3d-4649-9b37-7d29dca46c9f tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:07.607077 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-c1e065e9-6f3d-4649-9b37-7d29dca46c9f tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc47b0b30344863af004541d777915b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee28f39049846188135a087b194d247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:08:07.614651 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-c1e065e9-6f3d-4649-9b37-7d29dca46c9f tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] 10.222.0.70 "GET /compute/v2.1/servers/f4f48d71-846f-4e9a-8d3e-8e098aa3fa48" status: 200 len: 1504 microversion: 2.1 time: 0.158883 Jun 16 19:08:07.615218 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 491/1001] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:07 2022] GET /compute/v2.1/servers/f4f48d71-846f-4e9a-8d3e-8e098aa3fa48 => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:08:07.990423 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-8536defa-6426-4d78-a116-6a57dc1c1c7b tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:07.991186 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-8536defa-6426-4d78-a116-6a57dc1c1c7b tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: 312b94f9-6264-4dc8-81d3-c5d966852f12] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:07.998146 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-8536defa-6426-4d78-a116-6a57dc1c1c7b tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:07.998659 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-8536defa-6426-4d78-a116-6a57dc1c1c7b tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:07.999510 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-8536defa-6426-4d78-a116-6a57dc1c1c7b tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:07.999960 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-8536defa-6426-4d78-a116-6a57dc1c1c7b tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:08.131091 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-8536defa-6426-4d78-a116-6a57dc1c1c7b tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:08:08.138551 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-8536defa-6426-4d78-a116-6a57dc1c1c7b tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/312b94f9-6264-4dc8-81d3-c5d966852f12" status: 200 len: 1265 microversion: 2.1 time: 0.154448 Jun 16 19:08:08.139138 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 511/1002] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:07 2022] GET /compute/v2.1/servers/312b94f9-6264-4dc8-81d3-c5d966852f12 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:08:08.342218 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [req-949a0b4e-6889-4bc9-8124-5e2ffc1fb0c7 req-92846b12-7a57-4dda-9ea1-c31a65659005 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4f48d71-846f-4e9a-8d3e-8e098aa3fa48", "name": "network-vif-deleted", "tag": "5f6b0f24-a011-43dd-9041-0303f1759fc0"}]} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:08:08.351087 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-949a0b4e-6889-4bc9-8124-5e2ffc1fb0c7 req-92846b12-7a57-4dda-9ea1-c31a65659005 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:08.351627 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-949a0b4e-6889-4bc9-8124-5e2ffc1fb0c7 req-92846b12-7a57-4dda-9ea1-c31a65659005 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:08.364160 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.compute.server_external_events [req-949a0b4e-6889-4bc9-8124-5e2ffc1fb0c7 req-92846b12-7a57-4dda-9ea1-c31a65659005 service nova] Creating event network-vif-deleted:5f6b0f24-a011-43dd-9041-0303f1759fc0 for instance f4f48d71-846f-4e9a-8d3e-8e098aa3fa48 on hv-cinder-84617 Jun 16 19:08:08.368901 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [req-949a0b4e-6889-4bc9-8124-5e2ffc1fb0c7 req-92846b12-7a57-4dda-9ea1-c31a65659005 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031152 Jun 16 19:08:08.369503 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 492/1003] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:08:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:08:08.632161 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-befdd11f-105c-4592-a379-71c7ff9705b9 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:08.632695 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-befdd11f-105c-4592-a379-71c7ff9705b9 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] [instance: f4f48d71-846f-4e9a-8d3e-8e098aa3fa48] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:08.640792 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-befdd11f-105c-4592-a379-71c7ff9705b9 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:08.641239 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-befdd11f-105c-4592-a379-71c7ff9705b9 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:08.642033 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-befdd11f-105c-4592-a379-71c7ff9705b9 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:08.642466 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-befdd11f-105c-4592-a379-71c7ff9705b9 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:08.673488 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-befdd11f-105c-4592-a379-71c7ff9705b9 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:08.673930 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-befdd11f-105c-4592-a379-71c7ff9705b9 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:08.674370 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.objects.instance [None req-befdd11f-105c-4592-a379-71c7ff9705b9 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lazy-loading 'fault' on Instance uuid f4f48d71-846f-4e9a-8d3e-8e098aa3fa48 {{(pid=117852) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:08:08.720330 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-befdd11f-105c-4592-a379-71c7ff9705b9 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc47b0b30344863af004541d777915b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee28f39049846188135a087b194d247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:08:08.728221 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-befdd11f-105c-4592-a379-71c7ff9705b9 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] 10.222.0.70 "GET /compute/v2.1/servers/f4f48d71-846f-4e9a-8d3e-8e098aa3fa48" status: 200 len: 1304 microversion: 2.1 time: 0.100098 Jun 16 19:08:08.731928 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 512/1004] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:08 2022] GET /compute/v2.1/servers/f4f48d71-846f-4e9a-8d3e-8e098aa3fa48 => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:08:09.157549 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-1372a9e1-e6ef-479a-a02e-c6c5403cf634 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:09.158255 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-1372a9e1-e6ef-479a-a02e-c6c5403cf634 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: 312b94f9-6264-4dc8-81d3-c5d966852f12] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:09.164501 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-1372a9e1-e6ef-479a-a02e-c6c5403cf634 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:09.164949 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-1372a9e1-e6ef-479a-a02e-c6c5403cf634 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:09.165708 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-1372a9e1-e6ef-479a-a02e-c6c5403cf634 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:09.166146 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-1372a9e1-e6ef-479a-a02e-c6c5403cf634 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:09.298134 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-1372a9e1-e6ef-479a-a02e-c6c5403cf634 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:08:09.305538 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-1372a9e1-e6ef-479a-a02e-c6c5403cf634 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/312b94f9-6264-4dc8-81d3-c5d966852f12" status: 200 len: 1265 microversion: 2.1 time: 0.153687 Jun 16 19:08:09.306101 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 493/1005] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:09 2022] GET /compute/v2.1/servers/312b94f9-6264-4dc8-81d3-c5d966852f12 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:08:09.746473 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-d9b5f0bb-d4b7-4705-b469-3d47b736250a tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:09.747379 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-d9b5f0bb-d4b7-4705-b469-3d47b736250a tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] [instance: f4f48d71-846f-4e9a-8d3e-8e098aa3fa48] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:09.753756 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d9b5f0bb-d4b7-4705-b469-3d47b736250a tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:09.754141 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d9b5f0bb-d4b7-4705-b469-3d47b736250a tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:09.754943 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d9b5f0bb-d4b7-4705-b469-3d47b736250a tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:09.755377 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d9b5f0bb-d4b7-4705-b469-3d47b736250a tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:09.769673 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.wsgi [None req-d9b5f0bb-d4b7-4705-b469-3d47b736250a tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] HTTP exception thrown: Instance f4f48d71-846f-4e9a-8d3e-8e098aa3fa48 could not be found. Jun 16 19:08:09.771350 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-d9b5f0bb-d4b7-4705-b469-3d47b736250a tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Request method failure captured: Jun 16 19:08:09.771350 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: request: GET /compute/v2.1/servers/f4f48d71-846f-4e9a-8d3e-8e098aa3fa48 HTTP/1.1 Jun 16 19:08:09.771350 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Accept: application/json Jun 16 19:08:09.771350 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Accept-Encoding: identity Jun 16 19:08:09.771350 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Connection: close Jun 16 19:08:09.771350 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Content-Length: 0 Jun 16 19:08:09.771350 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Content-Type: application/json Jun 16 19:08:09.771350 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Host: 10.222.0.70 Jun 16 19:08:09.771350 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Openstack-System-Scope: None Jun 16 19:08:09.771350 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: User-Agent: python-urllib3/1.26.9 Jun 16 19:08:09.771350 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Auth-Token: gAAAAABiq3-GSRzmUvFwkqwjh3t2Ducf0Bk-da27A6NRaz1-_2tcqcKj_PVlhYBb8smv7szw94yNSlOZ-KXJTafpEnvZcQHOfDR2iy7HYgOFCAbsEbSyZ8Y8tcp8oI8OC2vo1yR40bbyx4CBwMlTNAJRMazqRqNKOEC3U18dx2y9BRSoQ6uolR8 Jun 16 19:08:09.771350 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Domain-Id: None Jun 16 19:08:09.771350 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Domain-Name: None Jun 16 19:08:09.771350 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Identity-Status: Confirmed Jun 16 19:08:09.771350 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Is-Admin-Project: True Jun 16 19:08:09.771350 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Domain-Id: default Jun 16 19:08:09.771350 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Domain-Name: Default Jun 16 19:08:09.771350 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Id: 8ee28f39049846188135a087b194d247 Jun 16 19:08:09.771350 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Name: tempest-VolumesActionsTest-1022676868 Jun 16 19:08:09.771350 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Role: member,reader Jun 16 19:08:09.771350 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Roles: member,reader Jun 16 19:08:09.773202 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8ee28f39049846188135a087b194d247"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8ee28f39049846188135a087b194d247", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8ee28f39049846188135a087b194d247"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8ee28f39049846188135a087b194d247"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 16 19:08:09.773202 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant: tempest-VolumesActionsTest-1022676868 Jun 16 19:08:09.773202 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant-Id: 8ee28f39049846188135a087b194d247 Jun 16 19:08:09.773202 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant-Name: tempest-VolumesActionsTest-1022676868 Jun 16 19:08:09.773202 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User: tempest-VolumesActionsTest-1022676868-project Jun 16 19:08:09.773202 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Domain-Id: default Jun 16 19:08:09.773202 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Domain-Name: Default Jun 16 19:08:09.773202 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Id: 4fc47b0b30344863af004541d777915b Jun 16 19:08:09.773202 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Name: tempest-VolumesActionsTest-1022676868-project Jun 16 19:08:09.773202 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: method: > Jun 16 19:08:09.773202 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: exception: Instance f4f48d71-846f-4e9a-8d3e-8e098aa3fa48 could not be found. Jun 16 19:08:09.773202 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: action_args: {'id': 'f4f48d71-846f-4e9a-8d3e-8e098aa3fa48'} Jun 16 19:08:09.774348 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:08:09.774348 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:08:09.774348 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:08:09.774348 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:08:09.774348 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:08:09.774348 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:08:09.774348 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:08:09.774348 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:08:09.774348 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:08:09.774348 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:08:09.774348 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4f48d71-846f-4e9a-8d3e-8e098aa3fa48 could not be found. Jun 16 19:08:09.774348 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:08:09.774348 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:08:09.774348 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:08:09.774348 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:08:09.774348 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:08:09.774348 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:08:09.774348 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:08:09.774348 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:08:09.774348 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:08:09.776338 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:08:09.776338 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:08:09.776338 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:08:09.776338 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:08:09.776338 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:08:09.776338 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:08:09.776338 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:08:09.776338 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4f48d71-846f-4e9a-8d3e-8e098aa3fa48 could not be found. Jun 16 19:08:09.776338 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:08:09.776338 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:08:09.776338 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:08:09.776338 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:08:09.776338 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:08:09.776338 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:08:09.776338 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:08:09.776338 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:08:09.776338 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4f48d71-846f-4e9a-8d3e-8e098aa3fa48 could not be found. Jun 16 19:08:09.776338 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:08:09.777883 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-d9b5f0bb-d4b7-4705-b469-3d47b736250a tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Returning 404 to user: Instance f4f48d71-846f-4e9a-8d3e-8e098aa3fa48 could not be found. {{(pid=117852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:08:09.777883 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-d9b5f0bb-d4b7-4705-b469-3d47b736250a tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] 10.222.0.70 "GET /compute/v2.1/servers/f4f48d71-846f-4e9a-8d3e-8e098aa3fa48" status: 404 len: 111 microversion: 2.1 time: 0.030793 Jun 16 19:08:09.777883 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 513/1006] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:09 2022] GET /compute/v2.1/servers/f4f48d71-846f-4e9a-8d3e-8e098aa3fa48 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:08:09.881695 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-82988beb-6daf-49cc-a06d-38f450ad6cd0 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-164860396", "imageRef": "1d993e69-7f01-4fe0-ba52-0eae2fa43ddf", "flavorRef": "452", "networks": [{"uuid": "a4ead1e7-3691-400b-ab98-1ae7122f29fc"}]}} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:08:09.932756 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.network.neutron [None req-82988beb-6daf-49cc-a06d-38f450ad6cd0 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] validate_networks() for [('a4ead1e7-3691-400b-ab98-1ae7122f29fc', None, None, None, None, None)] {{(pid=117850) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:08:10.288493 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-82988beb-6daf-49cc-a06d-38f450ad6cd0 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Flavor limits 0:0:0 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:08:10.289058 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-82988beb-6daf-49cc-a06d-38f450ad6cd0 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Image limits 0:0:0 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:08:10.289437 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-82988beb-6daf-49cc-a06d-38f450ad6cd0 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Flavor pref 0:0:0 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:08:10.289866 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-82988beb-6daf-49cc-a06d-38f450ad6cd0 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Image pref 0:0:0 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:08:10.290284 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-82988beb-6daf-49cc-a06d-38f450ad6cd0 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:08:10.302929 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-82988beb-6daf-49cc-a06d-38f450ad6cd0 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:10.303317 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-82988beb-6daf-49cc-a06d-38f450ad6cd0 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:10.304161 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-82988beb-6daf-49cc-a06d-38f450ad6cd0 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:10.304600 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-82988beb-6daf-49cc-a06d-38f450ad6cd0 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:10.321603 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.quota [None req-82988beb-6daf-49cc-a06d-38f450ad6cd0 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Getting quotas for project 8ee28f39049846188135a087b194d247. Resources: {'cores', 'ram', 'instances'} {{(pid=117850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:08:10.322675 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-3773d0dd-887b-4f57-82a3-d487fdafb0b1 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:10.323389 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-3773d0dd-887b-4f57-82a3-d487fdafb0b1 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: 312b94f9-6264-4dc8-81d3-c5d966852f12] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:10.326093 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.quota [None req-82988beb-6daf-49cc-a06d-38f450ad6cd0 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Getting quotas for user 4fc47b0b30344863af004541d777915b and project 8ee28f39049846188135a087b194d247. Resources: {'cores', 'ram', 'instances'} {{(pid=117850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:08:10.329698 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-3773d0dd-887b-4f57-82a3-d487fdafb0b1 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:10.330142 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-3773d0dd-887b-4f57-82a3-d487fdafb0b1 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:10.330926 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-3773d0dd-887b-4f57-82a3-d487fdafb0b1 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:10.331359 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-3773d0dd-887b-4f57-82a3-d487fdafb0b1 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:10.337988 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-82988beb-6daf-49cc-a06d-38f450ad6cd0 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Going to run 1 instances... {{(pid=117850) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:08:10.340603 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-82988beb-6daf-49cc-a06d-38f450ad6cd0 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] [instance: ec490ba5-bed3-455b-8de2-3ba609d024a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1d993e69-7f01-4fe0-ba52-0eae2fa43ddf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:08:10.387129 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-82988beb-6daf-49cc-a06d-38f450ad6cd0 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.509322 Jun 16 19:08:10.392714 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 494/1007] 10.222.0.70 () {60 vars in 1146 bytes} [Thu Jun 16 19:08:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 511 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:08:10.397744 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-1588b2f6-e67e-46ed-abbe-1748fb56b599 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:10.398591 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-1588b2f6-e67e-46ed-abbe-1748fb56b599 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] [instance: ec490ba5-bed3-455b-8de2-3ba609d024a3] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:10.402943 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:08:10.460339 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-1588b2f6-e67e-46ed-abbe-1748fb56b599 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc47b0b30344863af004541d777915b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee28f39049846188135a087b194d247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:08:10.470548 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-1588b2f6-e67e-46ed-abbe-1748fb56b599 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] 10.222.0.70 "GET /compute/v2.1/servers/ec490ba5-bed3-455b-8de2-3ba609d024a3" status: 200 len: 1213 microversion: 2.1 time: 0.076734 Jun 16 19:08:10.471213 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 495/1008] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:10 2022] GET /compute/v2.1/servers/ec490ba5-bed3-455b-8de2-3ba609d024a3 => generated 1213 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:08:10.483619 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-3773d0dd-887b-4f57-82a3-d487fdafb0b1 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:08:10.492058 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-3773d0dd-887b-4f57-82a3-d487fdafb0b1 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/312b94f9-6264-4dc8-81d3-c5d966852f12" status: 200 len: 1265 microversion: 2.1 time: 0.173299 Jun 16 19:08:10.492690 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 514/1009] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:10 2022] GET /compute/v2.1/servers/312b94f9-6264-4dc8-81d3-c5d966852f12 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:08:11.487870 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-69559e02-3f35-45ea-acf6-03a9d8f6d1ef tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:11.488497 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-69559e02-3f35-45ea-acf6-03a9d8f6d1ef tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] [instance: ec490ba5-bed3-455b-8de2-3ba609d024a3] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:11.497541 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-69559e02-3f35-45ea-acf6-03a9d8f6d1ef tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:11.498181 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-69559e02-3f35-45ea-acf6-03a9d8f6d1ef tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:11.498996 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-69559e02-3f35-45ea-acf6-03a9d8f6d1ef tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:11.499416 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-69559e02-3f35-45ea-acf6-03a9d8f6d1ef tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:11.511758 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-696106b5-28b2-4a6c-b19b-0f715810f6dd tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:11.513194 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-696106b5-28b2-4a6c-b19b-0f715810f6dd tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: 312b94f9-6264-4dc8-81d3-c5d966852f12] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:11.522300 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-696106b5-28b2-4a6c-b19b-0f715810f6dd tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:11.523367 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-696106b5-28b2-4a6c-b19b-0f715810f6dd tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:11.524341 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-696106b5-28b2-4a6c-b19b-0f715810f6dd tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:11.525351 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-696106b5-28b2-4a6c-b19b-0f715810f6dd tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:11.576808 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-69559e02-3f35-45ea-acf6-03a9d8f6d1ef tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc47b0b30344863af004541d777915b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee28f39049846188135a087b194d247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:08:11.585423 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-69559e02-3f35-45ea-acf6-03a9d8f6d1ef tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] 10.222.0.70 "GET /compute/v2.1/servers/ec490ba5-bed3-455b-8de2-3ba609d024a3" status: 200 len: 1271 microversion: 2.1 time: 0.101301 Jun 16 19:08:11.586486 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 496/1010] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:11 2022] GET /compute/v2.1/servers/ec490ba5-bed3-455b-8de2-3ba609d024a3 => generated 1271 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:08:11.592488 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [req-8f8eb484-89e8-43f9-8acf-21f1c6d4375f req-679784da-ff7c-4bd9-a24f-c3b46dc33c58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "312b94f9-6264-4dc8-81d3-c5d966852f12", "name": "network-vif-plugged", "status": "completed", "tag": "0ff62f9c-41e5-451d-8042-badc5173ffd1"}]} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:08:11.601406 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-8f8eb484-89e8-43f9-8acf-21f1c6d4375f req-679784da-ff7c-4bd9-a24f-c3b46dc33c58 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:11.601962 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-8f8eb484-89e8-43f9-8acf-21f1c6d4375f req-679784da-ff7c-4bd9-a24f-c3b46dc33c58 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:11.616376 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.compute.server_external_events [req-8f8eb484-89e8-43f9-8acf-21f1c6d4375f req-679784da-ff7c-4bd9-a24f-c3b46dc33c58 service nova] Creating event network-vif-plugged:0ff62f9c-41e5-451d-8042-badc5173ffd1 for instance 312b94f9-6264-4dc8-81d3-c5d966852f12 on hv-cinder-84617 Jun 16 19:08:11.624269 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [req-8f8eb484-89e8-43f9-8acf-21f1c6d4375f req-679784da-ff7c-4bd9-a24f-c3b46dc33c58 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036374 Jun 16 19:08:11.625262 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 497/1011] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:08:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:08:11.709323 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-696106b5-28b2-4a6c-b19b-0f715810f6dd tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:08:11.717828 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-696106b5-28b2-4a6c-b19b-0f715810f6dd tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/312b94f9-6264-4dc8-81d3-c5d966852f12" status: 200 len: 1265 microversion: 2.1 time: 0.210728 Jun 16 19:08:11.718389 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 515/1012] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:11 2022] GET /compute/v2.1/servers/312b94f9-6264-4dc8-81d3-c5d966852f12 => generated 1265 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:08:12.603072 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-01ab283b-5a28-421e-9ce6-2d398fc6131d tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:12.603786 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-01ab283b-5a28-421e-9ce6-2d398fc6131d tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] [instance: ec490ba5-bed3-455b-8de2-3ba609d024a3] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:12.611392 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-01ab283b-5a28-421e-9ce6-2d398fc6131d tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:12.611848 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-01ab283b-5a28-421e-9ce6-2d398fc6131d tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:12.612618 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-01ab283b-5a28-421e-9ce6-2d398fc6131d tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:12.613060 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-01ab283b-5a28-421e-9ce6-2d398fc6131d tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:12.740431 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-1c83c122-0244-4b32-8826-d70ddd78f790 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:12.741043 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-1c83c122-0244-4b32-8826-d70ddd78f790 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: 312b94f9-6264-4dc8-81d3-c5d966852f12] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:12.747605 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-1c83c122-0244-4b32-8826-d70ddd78f790 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:12.748309 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-1c83c122-0244-4b32-8826-d70ddd78f790 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:12.748907 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-1c83c122-0244-4b32-8826-d70ddd78f790 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:12.749342 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-1c83c122-0244-4b32-8826-d70ddd78f790 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:12.820260 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-01ab283b-5a28-421e-9ce6-2d398fc6131d tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc47b0b30344863af004541d777915b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee28f39049846188135a087b194d247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:08:12.830512 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-01ab283b-5a28-421e-9ce6-2d398fc6131d tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] 10.222.0.70 "GET /compute/v2.1/servers/ec490ba5-bed3-455b-8de2-3ba609d024a3" status: 200 len: 1313 microversion: 2.1 time: 0.232058 Jun 16 19:08:12.831185 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 498/1013] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:12 2022] GET /compute/v2.1/servers/ec490ba5-bed3-455b-8de2-3ba609d024a3 => generated 1313 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:08:12.892199 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-1c83c122-0244-4b32-8826-d70ddd78f790 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:08:12.899630 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-1c83c122-0244-4b32-8826-d70ddd78f790 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/312b94f9-6264-4dc8-81d3-c5d966852f12" status: 200 len: 1265 microversion: 2.1 time: 0.163027 Jun 16 19:08:12.900446 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 516/1014] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:12 2022] GET /compute/v2.1/servers/312b94f9-6264-4dc8-81d3-c5d966852f12 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:08:12.939980 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [req-e28bd9d0-4f5f-467a-8708-d82b33652023 req-2ba92415-3b91-42ef-82c5-b40c06ce8f97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec490ba5-bed3-455b-8de2-3ba609d024a3", "tag": "acd6355e-4cf0-42e4-9245-d1bcb8e89f8a"}]} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:08:12.954155 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-e28bd9d0-4f5f-467a-8708-d82b33652023 req-2ba92415-3b91-42ef-82c5-b40c06ce8f97 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:12.954733 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-e28bd9d0-4f5f-467a-8708-d82b33652023 req-2ba92415-3b91-42ef-82c5-b40c06ce8f97 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:12.971885 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.compute.server_external_events [req-e28bd9d0-4f5f-467a-8708-d82b33652023 req-2ba92415-3b91-42ef-82c5-b40c06ce8f97 service nova] Creating event network-changed:acd6355e-4cf0-42e4-9245-d1bcb8e89f8a for instance ec490ba5-bed3-455b-8de2-3ba609d024a3 on hv-cinder-84617 Jun 16 19:08:12.976499 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [req-e28bd9d0-4f5f-467a-8708-d82b33652023 req-2ba92415-3b91-42ef-82c5-b40c06ce8f97 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040405 Jun 16 19:08:12.977085 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 499/1015] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:08:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:08:13.848985 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-310b4224-63d4-441b-98cd-f0dd137669b8 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:13.849551 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-310b4224-63d4-441b-98cd-f0dd137669b8 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] [instance: ec490ba5-bed3-455b-8de2-3ba609d024a3] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:13.856958 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-310b4224-63d4-441b-98cd-f0dd137669b8 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:13.857401 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-310b4224-63d4-441b-98cd-f0dd137669b8 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:13.858158 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-310b4224-63d4-441b-98cd-f0dd137669b8 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:13.858614 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-310b4224-63d4-441b-98cd-f0dd137669b8 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:13.919178 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-adbc5d7c-37d7-481b-aa67-570e9de7449b tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:13.920472 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-adbc5d7c-37d7-481b-aa67-570e9de7449b tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: 312b94f9-6264-4dc8-81d3-c5d966852f12] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:13.928435 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-adbc5d7c-37d7-481b-aa67-570e9de7449b tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:13.928893 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-adbc5d7c-37d7-481b-aa67-570e9de7449b tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:13.929674 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-adbc5d7c-37d7-481b-aa67-570e9de7449b tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:13.930120 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-adbc5d7c-37d7-481b-aa67-570e9de7449b tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:13.993761 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-310b4224-63d4-441b-98cd-f0dd137669b8 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc47b0b30344863af004541d777915b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee28f39049846188135a087b194d247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:08:14.001257 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-310b4224-63d4-441b-98cd-f0dd137669b8 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] 10.222.0.70 "GET /compute/v2.1/servers/ec490ba5-bed3-455b-8de2-3ba609d024a3" status: 200 len: 1313 microversion: 2.1 time: 0.156230 Jun 16 19:08:14.001839 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 517/1016] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:13 2022] GET /compute/v2.1/servers/ec490ba5-bed3-455b-8de2-3ba609d024a3 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:08:14.066606 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-adbc5d7c-37d7-481b-aa67-570e9de7449b tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:08:14.074344 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-adbc5d7c-37d7-481b-aa67-570e9de7449b tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/312b94f9-6264-4dc8-81d3-c5d966852f12" status: 200 len: 1453 microversion: 2.1 time: 0.160684 Jun 16 19:08:14.075264 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 500/1017] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:13 2022] GET /compute/v2.1/servers/312b94f9-6264-4dc8-81d3-c5d966852f12 => generated 1453 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:08:14.092772 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-10764647-0824-4d24-af33-940a0dbd7bde tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:14.093378 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-10764647-0824-4d24-af33-940a0dbd7bde tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: 312b94f9-6264-4dc8-81d3-c5d966852f12] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:14.100110 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-10764647-0824-4d24-af33-940a0dbd7bde tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:14.100491 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-10764647-0824-4d24-af33-940a0dbd7bde tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:14.101244 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-10764647-0824-4d24-af33-940a0dbd7bde tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:14.101676 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-10764647-0824-4d24-af33-940a0dbd7bde tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:14.235899 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-10764647-0824-4d24-af33-940a0dbd7bde tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:08:14.243532 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-10764647-0824-4d24-af33-940a0dbd7bde tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/312b94f9-6264-4dc8-81d3-c5d966852f12" status: 200 len: 1453 microversion: 2.1 time: 0.155151 Jun 16 19:08:14.244091 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 518/1018] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:14 2022] GET /compute/v2.1/servers/312b94f9-6264-4dc8-81d3-c5d966852f12 => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:08:15.017987 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-f4ad5556-d89e-402a-994f-b1fdeb11d8fe tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:15.018745 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-f4ad5556-d89e-402a-994f-b1fdeb11d8fe tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] [instance: ec490ba5-bed3-455b-8de2-3ba609d024a3] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:15.026074 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-f4ad5556-d89e-402a-994f-b1fdeb11d8fe tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:15.026528 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-f4ad5556-d89e-402a-994f-b1fdeb11d8fe tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:15.027441 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-f4ad5556-d89e-402a-994f-b1fdeb11d8fe tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:15.028076 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-f4ad5556-d89e-402a-994f-b1fdeb11d8fe tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:15.329541 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-f4ad5556-d89e-402a-994f-b1fdeb11d8fe tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc47b0b30344863af004541d777915b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee28f39049846188135a087b194d247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:08:15.336980 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-f4ad5556-d89e-402a-994f-b1fdeb11d8fe tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] 10.222.0.70 "GET /compute/v2.1/servers/ec490ba5-bed3-455b-8de2-3ba609d024a3" status: 200 len: 1313 microversion: 2.1 time: 0.322971 Jun 16 19:08:15.337947 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 501/1019] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:15 2022] GET /compute/v2.1/servers/ec490ba5-bed3-455b-8de2-3ba609d024a3 => generated 1313 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:08:16.353931 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-15ea6635-9f78-4547-8794-4b5bed436ca5 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:16.354557 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-15ea6635-9f78-4547-8794-4b5bed436ca5 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] [instance: ec490ba5-bed3-455b-8de2-3ba609d024a3] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:16.361277 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-15ea6635-9f78-4547-8794-4b5bed436ca5 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:16.361726 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-15ea6635-9f78-4547-8794-4b5bed436ca5 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:16.362505 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-15ea6635-9f78-4547-8794-4b5bed436ca5 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:16.362966 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-15ea6635-9f78-4547-8794-4b5bed436ca5 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:16.497395 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-15ea6635-9f78-4547-8794-4b5bed436ca5 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc47b0b30344863af004541d777915b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee28f39049846188135a087b194d247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:08:16.506381 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-15ea6635-9f78-4547-8794-4b5bed436ca5 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] 10.222.0.70 "GET /compute/v2.1/servers/ec490ba5-bed3-455b-8de2-3ba609d024a3" status: 200 len: 1313 microversion: 2.1 time: 0.156187 Jun 16 19:08:16.507500 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 519/1020] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:16 2022] GET /compute/v2.1/servers/ec490ba5-bed3-455b-8de2-3ba609d024a3 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:08:17.189902 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [req-f1b9f539-97f2-4ad6-8a3f-ebf55a969c3a req-8b053efe-7efe-43e1-8589-7545689f2753 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "312b94f9-6264-4dc8-81d3-c5d966852f12", "tag": "0ff62f9c-41e5-451d-8042-badc5173ffd1"}]} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:08:17.198623 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-f1b9f539-97f2-4ad6-8a3f-ebf55a969c3a req-8b053efe-7efe-43e1-8589-7545689f2753 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:17.199296 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-f1b9f539-97f2-4ad6-8a3f-ebf55a969c3a req-8b053efe-7efe-43e1-8589-7545689f2753 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:17.210698 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.compute.server_external_events [req-f1b9f539-97f2-4ad6-8a3f-ebf55a969c3a req-8b053efe-7efe-43e1-8589-7545689f2753 service nova] Creating event network-changed:0ff62f9c-41e5-451d-8042-badc5173ffd1 for instance 312b94f9-6264-4dc8-81d3-c5d966852f12 on hv-cinder-84617 Jun 16 19:08:17.215592 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [req-f1b9f539-97f2-4ad6-8a3f-ebf55a969c3a req-8b053efe-7efe-43e1-8589-7545689f2753 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029338 Jun 16 19:08:17.216178 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 502/1021] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:08:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:08:17.524086 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-28ccab64-1b7e-462a-b9b6-e0d2020d85fc tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:17.525633 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-28ccab64-1b7e-462a-b9b6-e0d2020d85fc tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] [instance: ec490ba5-bed3-455b-8de2-3ba609d024a3] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:17.534271 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-28ccab64-1b7e-462a-b9b6-e0d2020d85fc tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:17.535442 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-28ccab64-1b7e-462a-b9b6-e0d2020d85fc tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:17.536403 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-28ccab64-1b7e-462a-b9b6-e0d2020d85fc tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:17.536838 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-28ccab64-1b7e-462a-b9b6-e0d2020d85fc tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:17.682623 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-28ccab64-1b7e-462a-b9b6-e0d2020d85fc tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc47b0b30344863af004541d777915b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee28f39049846188135a087b194d247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:08:17.692061 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-28ccab64-1b7e-462a-b9b6-e0d2020d85fc tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] 10.222.0.70 "GET /compute/v2.1/servers/ec490ba5-bed3-455b-8de2-3ba609d024a3" status: 200 len: 1313 microversion: 2.1 time: 0.171853 Jun 16 19:08:17.693014 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 520/1022] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:17 2022] GET /compute/v2.1/servers/ec490ba5-bed3-455b-8de2-3ba609d024a3 => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:08:18.711706 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-e863c293-25d5-4176-8c76-b92e3662061a tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:18.712415 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-e863c293-25d5-4176-8c76-b92e3662061a tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] [instance: ec490ba5-bed3-455b-8de2-3ba609d024a3] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:18.719653 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-e863c293-25d5-4176-8c76-b92e3662061a tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:18.720117 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-e863c293-25d5-4176-8c76-b92e3662061a tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:18.720888 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-e863c293-25d5-4176-8c76-b92e3662061a tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:18.721328 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-e863c293-25d5-4176-8c76-b92e3662061a tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:18.860118 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-e863c293-25d5-4176-8c76-b92e3662061a tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc47b0b30344863af004541d777915b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee28f39049846188135a087b194d247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:08:18.867883 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-e863c293-25d5-4176-8c76-b92e3662061a tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] 10.222.0.70 "GET /compute/v2.1/servers/ec490ba5-bed3-455b-8de2-3ba609d024a3" status: 200 len: 1313 microversion: 2.1 time: 0.160946 Jun 16 19:08:18.868395 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 503/1023] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:18 2022] GET /compute/v2.1/servers/ec490ba5-bed3-455b-8de2-3ba609d024a3 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:08:19.583926 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [req-bcc29945-7faa-4293-9a7d-acc5f0794f83 req-deb82667-924f-495e-a282-6b8193d4e858 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec490ba5-bed3-455b-8de2-3ba609d024a3", "name": "network-vif-plugged", "status": "completed", "tag": "acd6355e-4cf0-42e4-9245-d1bcb8e89f8a"}]} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:08:19.593679 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-bcc29945-7faa-4293-9a7d-acc5f0794f83 req-deb82667-924f-495e-a282-6b8193d4e858 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:19.594344 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-bcc29945-7faa-4293-9a7d-acc5f0794f83 req-deb82667-924f-495e-a282-6b8193d4e858 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:19.606261 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.compute.server_external_events [req-bcc29945-7faa-4293-9a7d-acc5f0794f83 req-deb82667-924f-495e-a282-6b8193d4e858 service nova] Creating event network-vif-plugged:acd6355e-4cf0-42e4-9245-d1bcb8e89f8a for instance ec490ba5-bed3-455b-8de2-3ba609d024a3 on hv-cinder-84617 Jun 16 19:08:19.611269 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [req-bcc29945-7faa-4293-9a7d-acc5f0794f83 req-deb82667-924f-495e-a282-6b8193d4e858 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031488 Jun 16 19:08:19.612076 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 521/1024] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:08:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:08:19.885911 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-1dd004e4-9702-4eff-86cd-9da5ba98b506 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:19.887395 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-1dd004e4-9702-4eff-86cd-9da5ba98b506 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] [instance: ec490ba5-bed3-455b-8de2-3ba609d024a3] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:19.893725 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-1dd004e4-9702-4eff-86cd-9da5ba98b506 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:19.894172 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-1dd004e4-9702-4eff-86cd-9da5ba98b506 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:19.894991 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-1dd004e4-9702-4eff-86cd-9da5ba98b506 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:19.895520 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-1dd004e4-9702-4eff-86cd-9da5ba98b506 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:20.033617 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-1dd004e4-9702-4eff-86cd-9da5ba98b506 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc47b0b30344863af004541d777915b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee28f39049846188135a087b194d247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:08:20.041029 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-1dd004e4-9702-4eff-86cd-9da5ba98b506 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] 10.222.0.70 "GET /compute/v2.1/servers/ec490ba5-bed3-455b-8de2-3ba609d024a3" status: 200 len: 1313 microversion: 2.1 time: 0.160486 Jun 16 19:08:20.041598 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 504/1025] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:19 2022] GET /compute/v2.1/servers/ec490ba5-bed3-455b-8de2-3ba609d024a3 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:08:21.059647 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-87be22a4-a66f-495f-b56f-df2dc93043c4 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:21.060350 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-87be22a4-a66f-495f-b56f-df2dc93043c4 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] [instance: ec490ba5-bed3-455b-8de2-3ba609d024a3] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:21.066606 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-87be22a4-a66f-495f-b56f-df2dc93043c4 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:21.067072 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-87be22a4-a66f-495f-b56f-df2dc93043c4 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:21.067836 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-87be22a4-a66f-495f-b56f-df2dc93043c4 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:21.068278 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-87be22a4-a66f-495f-b56f-df2dc93043c4 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:21.086172 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:08:21.201851 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-87be22a4-a66f-495f-b56f-df2dc93043c4 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc47b0b30344863af004541d777915b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee28f39049846188135a087b194d247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:08:21.209184 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-87be22a4-a66f-495f-b56f-df2dc93043c4 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] 10.222.0.70 "GET /compute/v2.1/servers/ec490ba5-bed3-455b-8de2-3ba609d024a3" status: 200 len: 1313 microversion: 2.1 time: 0.154529 Jun 16 19:08:21.209735 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 522/1026] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:21 2022] GET /compute/v2.1/servers/ec490ba5-bed3-455b-8de2-3ba609d024a3 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:08:22.226596 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-14164886-2d5b-4e2f-9c26-37fb4a969095 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:22.227145 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-14164886-2d5b-4e2f-9c26-37fb4a969095 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] [instance: ec490ba5-bed3-455b-8de2-3ba609d024a3] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:22.229074 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_cell0:SELECT=2 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:08:22.229880 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_cell0:SELECT=8 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:08:22.237337 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-14164886-2d5b-4e2f-9c26-37fb4a969095 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:22.237794 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-14164886-2d5b-4e2f-9c26-37fb4a969095 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:22.238565 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-14164886-2d5b-4e2f-9c26-37fb4a969095 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:22.239142 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-14164886-2d5b-4e2f-9c26-37fb4a969095 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:22.369154 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-14164886-2d5b-4e2f-9c26-37fb4a969095 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc47b0b30344863af004541d777915b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee28f39049846188135a087b194d247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:08:22.377640 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-14164886-2d5b-4e2f-9c26-37fb4a969095 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] 10.222.0.70 "GET /compute/v2.1/servers/ec490ba5-bed3-455b-8de2-3ba609d024a3" status: 200 len: 1497 microversion: 2.1 time: 0.155027 Jun 16 19:08:22.378222 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 505/1027] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:22 2022] GET /compute/v2.1/servers/ec490ba5-bed3-455b-8de2-3ba609d024a3 => generated 1497 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:08:22.835296 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-d2cc4ee5-fd91-4bec-9b7c-01abb3d97935 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:22.835844 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-d2cc4ee5-fd91-4bec-9b7c-01abb3d97935 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] [instance: ec490ba5-bed3-455b-8de2-3ba609d024a3] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:22.844206 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d2cc4ee5-fd91-4bec-9b7c-01abb3d97935 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:22.844649 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d2cc4ee5-fd91-4bec-9b7c-01abb3d97935 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:22.845416 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d2cc4ee5-fd91-4bec-9b7c-01abb3d97935 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:22.845855 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d2cc4ee5-fd91-4bec-9b7c-01abb3d97935 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:22.875516 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-d2cc4ee5-fd91-4bec-9b7c-01abb3d97935 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] [instance: ec490ba5-bed3-455b-8de2-3ba609d024a3] Going to try to terminate instance {{(pid=117852) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:08:22.951460 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-d2cc4ee5-fd91-4bec-9b7c-01abb3d97935 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] 10.222.0.70 "DELETE /compute/v2.1/servers/ec490ba5-bed3-455b-8de2-3ba609d024a3" status: 204 len: 0 microversion: 2.1 time: 0.119796 Jun 16 19:08:22.952047 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 523/1028] 10.222.0.70 () {58 vars in 1238 bytes} [Thu Jun 16 19:08:22 2022] DELETE /compute/v2.1/servers/ec490ba5-bed3-455b-8de2-3ba609d024a3 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:08:22.961332 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-a90677a3-6648-4e2e-a9a4-9c104078ca7e tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:22.961963 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-a90677a3-6648-4e2e-a9a4-9c104078ca7e tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] [instance: ec490ba5-bed3-455b-8de2-3ba609d024a3] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:22.969052 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-a90677a3-6648-4e2e-a9a4-9c104078ca7e tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:22.969510 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-a90677a3-6648-4e2e-a9a4-9c104078ca7e tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:22.970297 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-a90677a3-6648-4e2e-a9a4-9c104078ca7e tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:22.970812 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-a90677a3-6648-4e2e-a9a4-9c104078ca7e tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:23.101361 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-a90677a3-6648-4e2e-a9a4-9c104078ca7e tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc47b0b30344863af004541d777915b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee28f39049846188135a087b194d247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:08:23.108901 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-a90677a3-6648-4e2e-a9a4-9c104078ca7e tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] 10.222.0.70 "GET /compute/v2.1/servers/ec490ba5-bed3-455b-8de2-3ba609d024a3" status: 200 len: 1503 microversion: 2.1 time: 0.152440 Jun 16 19:08:23.109473 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 506/1029] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:22 2022] GET /compute/v2.1/servers/ec490ba5-bed3-455b-8de2-3ba609d024a3 => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:08:24.126911 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-96568158-f7a5-448e-9005-5d24cc13e593 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:24.127620 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-96568158-f7a5-448e-9005-5d24cc13e593 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] [instance: ec490ba5-bed3-455b-8de2-3ba609d024a3] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:24.130072 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:08:24.135292 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-96568158-f7a5-448e-9005-5d24cc13e593 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:24.135750 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-96568158-f7a5-448e-9005-5d24cc13e593 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:24.136575 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-96568158-f7a5-448e-9005-5d24cc13e593 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:24.137019 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-96568158-f7a5-448e-9005-5d24cc13e593 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:24.274036 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-96568158-f7a5-448e-9005-5d24cc13e593 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc47b0b30344863af004541d777915b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee28f39049846188135a087b194d247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:08:24.282380 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-96568158-f7a5-448e-9005-5d24cc13e593 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] 10.222.0.70 "GET /compute/v2.1/servers/ec490ba5-bed3-455b-8de2-3ba609d024a3" status: 200 len: 1503 microversion: 2.1 time: 0.159879 Jun 16 19:08:24.282974 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 524/1030] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:24 2022] GET /compute/v2.1/servers/ec490ba5-bed3-455b-8de2-3ba609d024a3 => generated 1503 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:08:25.243048 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [req-af5a4949-b7fd-4377-91b6-b65e16624e13 req-493841ea-21b5-4cd0-8296-d5485d5a3c20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec490ba5-bed3-455b-8de2-3ba609d024a3", "name": "network-vif-deleted", "tag": "acd6355e-4cf0-42e4-9245-d1bcb8e89f8a"}]} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:08:25.252705 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-af5a4949-b7fd-4377-91b6-b65e16624e13 req-493841ea-21b5-4cd0-8296-d5485d5a3c20 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:25.253155 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-af5a4949-b7fd-4377-91b6-b65e16624e13 req-493841ea-21b5-4cd0-8296-d5485d5a3c20 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:25.265327 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.compute.server_external_events [req-af5a4949-b7fd-4377-91b6-b65e16624e13 req-493841ea-21b5-4cd0-8296-d5485d5a3c20 service nova] Creating event network-vif-deleted:acd6355e-4cf0-42e4-9245-d1bcb8e89f8a for instance ec490ba5-bed3-455b-8de2-3ba609d024a3 on hv-cinder-84617 Jun 16 19:08:25.270182 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [req-af5a4949-b7fd-4377-91b6-b65e16624e13 req-493841ea-21b5-4cd0-8296-d5485d5a3c20 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030863 Jun 16 19:08:25.270814 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 507/1031] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:08:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:08:25.300668 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-04d95a29-327d-4208-bde0-77cd107474bf tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:25.301381 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-04d95a29-327d-4208-bde0-77cd107474bf tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] [instance: ec490ba5-bed3-455b-8de2-3ba609d024a3] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:25.308065 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-04d95a29-327d-4208-bde0-77cd107474bf tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:25.309220 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-04d95a29-327d-4208-bde0-77cd107474bf tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:25.309948 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-04d95a29-327d-4208-bde0-77cd107474bf tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:25.310626 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-04d95a29-327d-4208-bde0-77cd107474bf tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:25.347095 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-04d95a29-327d-4208-bde0-77cd107474bf tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:25.347546 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-04d95a29-327d-4208-bde0-77cd107474bf tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:25.347993 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.objects.instance [None req-04d95a29-327d-4208-bde0-77cd107474bf tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lazy-loading 'fault' on Instance uuid ec490ba5-bed3-455b-8de2-3ba609d024a3 {{(pid=117852) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:08:25.388757 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-04d95a29-327d-4208-bde0-77cd107474bf tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc47b0b30344863af004541d777915b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ee28f39049846188135a087b194d247', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:08:25.396068 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-04d95a29-327d-4208-bde0-77cd107474bf tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] 10.222.0.70 "GET /compute/v2.1/servers/ec490ba5-bed3-455b-8de2-3ba609d024a3" status: 200 len: 1303 microversion: 2.1 time: 0.099371 Jun 16 19:08:25.396624 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 525/1032] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:25 2022] GET /compute/v2.1/servers/ec490ba5-bed3-455b-8de2-3ba609d024a3 => generated 1303 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:08:26.414387 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-ff22b021-fdaa-4d86-ba12-5ec63ff9d311 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:26.415026 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-ff22b021-fdaa-4d86-ba12-5ec63ff9d311 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] [instance: ec490ba5-bed3-455b-8de2-3ba609d024a3] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:26.421496 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-ff22b021-fdaa-4d86-ba12-5ec63ff9d311 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:26.421939 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-ff22b021-fdaa-4d86-ba12-5ec63ff9d311 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:26.422719 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-ff22b021-fdaa-4d86-ba12-5ec63ff9d311 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:26.423149 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-ff22b021-fdaa-4d86-ba12-5ec63ff9d311 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:26.436930 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.wsgi [None req-ff22b021-fdaa-4d86-ba12-5ec63ff9d311 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] HTTP exception thrown: Instance ec490ba5-bed3-455b-8de2-3ba609d024a3 could not be found. Jun 16 19:08:26.438757 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-ff22b021-fdaa-4d86-ba12-5ec63ff9d311 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Request method failure captured: Jun 16 19:08:26.438757 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: request: GET /compute/v2.1/servers/ec490ba5-bed3-455b-8de2-3ba609d024a3 HTTP/1.1 Jun 16 19:08:26.438757 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Accept: application/json Jun 16 19:08:26.438757 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Accept-Encoding: identity Jun 16 19:08:26.438757 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Connection: close Jun 16 19:08:26.438757 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Content-Length: 0 Jun 16 19:08:26.438757 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Content-Type: application/json Jun 16 19:08:26.438757 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Host: 10.222.0.70 Jun 16 19:08:26.438757 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Openstack-System-Scope: None Jun 16 19:08:26.438757 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: User-Agent: python-urllib3/1.26.9 Jun 16 19:08:26.438757 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Auth-Token: gAAAAABiq3-GSRzmUvFwkqwjh3t2Ducf0Bk-da27A6NRaz1-_2tcqcKj_PVlhYBb8smv7szw94yNSlOZ-KXJTafpEnvZcQHOfDR2iy7HYgOFCAbsEbSyZ8Y8tcp8oI8OC2vo1yR40bbyx4CBwMlTNAJRMazqRqNKOEC3U18dx2y9BRSoQ6uolR8 Jun 16 19:08:26.438757 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Domain-Id: None Jun 16 19:08:26.438757 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Domain-Name: None Jun 16 19:08:26.438757 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Identity-Status: Confirmed Jun 16 19:08:26.438757 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Is-Admin-Project: True Jun 16 19:08:26.438757 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Domain-Id: default Jun 16 19:08:26.438757 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Domain-Name: Default Jun 16 19:08:26.438757 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Id: 8ee28f39049846188135a087b194d247 Jun 16 19:08:26.438757 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Name: tempest-VolumesActionsTest-1022676868 Jun 16 19:08:26.438757 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Role: member,reader Jun 16 19:08:26.438757 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Roles: member,reader Jun 16 19:08:26.440525 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8ee28f39049846188135a087b194d247"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8ee28f39049846188135a087b194d247", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8ee28f39049846188135a087b194d247"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8ee28f39049846188135a087b194d247"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 16 19:08:26.440525 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant: tempest-VolumesActionsTest-1022676868 Jun 16 19:08:26.440525 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant-Id: 8ee28f39049846188135a087b194d247 Jun 16 19:08:26.440525 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant-Name: tempest-VolumesActionsTest-1022676868 Jun 16 19:08:26.440525 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User: tempest-VolumesActionsTest-1022676868-project Jun 16 19:08:26.440525 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Domain-Id: default Jun 16 19:08:26.440525 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Domain-Name: Default Jun 16 19:08:26.440525 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Id: 4fc47b0b30344863af004541d777915b Jun 16 19:08:26.440525 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Name: tempest-VolumesActionsTest-1022676868-project Jun 16 19:08:26.440525 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: method: > Jun 16 19:08:26.440525 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: exception: Instance ec490ba5-bed3-455b-8de2-3ba609d024a3 could not be found. Jun 16 19:08:26.440525 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: action_args: {'id': 'ec490ba5-bed3-455b-8de2-3ba609d024a3'} Jun 16 19:08:26.441543 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:08:26.441543 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:08:26.441543 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:08:26.441543 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:08:26.441543 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:08:26.441543 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:08:26.441543 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:08:26.441543 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:08:26.441543 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:08:26.441543 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:08:26.441543 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec490ba5-bed3-455b-8de2-3ba609d024a3 could not be found. Jun 16 19:08:26.441543 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:08:26.441543 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:08:26.441543 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:08:26.441543 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:08:26.441543 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:08:26.441543 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:08:26.441543 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:08:26.441543 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:08:26.441543 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:08:26.443117 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:08:26.443117 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:08:26.443117 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:08:26.443117 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:08:26.443117 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:08:26.443117 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:08:26.443117 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:08:26.443117 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec490ba5-bed3-455b-8de2-3ba609d024a3 could not be found. Jun 16 19:08:26.443117 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:08:26.443117 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:08:26.443117 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:08:26.443117 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:08:26.443117 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:08:26.443117 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:08:26.443117 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:08:26.443117 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:08:26.443117 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec490ba5-bed3-455b-8de2-3ba609d024a3 could not be found. Jun 16 19:08:26.443117 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:08:26.444469 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-ff22b021-fdaa-4d86-ba12-5ec63ff9d311 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] Returning 404 to user: Instance ec490ba5-bed3-455b-8de2-3ba609d024a3 could not be found. {{(pid=117850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:08:26.444469 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-ff22b021-fdaa-4d86-ba12-5ec63ff9d311 tempest-VolumesActionsTest-1022676868 tempest-VolumesActionsTest-1022676868-project] 10.222.0.70 "GET /compute/v2.1/servers/ec490ba5-bed3-455b-8de2-3ba609d024a3" status: 404 len: 111 microversion: 2.1 time: 0.030505 Jun 16 19:08:26.444469 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 508/1033] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:26 2022] GET /compute/v2.1/servers/ec490ba5-bed3-455b-8de2-3ba609d024a3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:08:43.828782 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-2bf19b90-7fca-4408-a8e4-9b2a6b031a45 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:43.829362 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-2bf19b90-7fca-4408-a8e4-9b2a6b031a45 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 7a805bc0-29bf-4ca0-80b2-e2ee71912d51] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:43.836285 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_api:SELECT=5 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:08:43.836926 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:08:43.839143 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-2bf19b90-7fca-4408-a8e4-9b2a6b031a45 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:43.841859 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-2bf19b90-7fca-4408-a8e4-9b2a6b031a45 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:43.841859 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-2bf19b90-7fca-4408-a8e4-9b2a6b031a45 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:43.841859 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-2bf19b90-7fca-4408-a8e4-9b2a6b031a45 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:43.868481 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-2bf19b90-7fca-4408-a8e4-9b2a6b031a45 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/7a805bc0-29bf-4ca0-80b2-e2ee71912d51/ips" status: 200 len: 148 microversion: 2.1 time: 0.043565 Jun 16 19:08:43.874888 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 526/1034] 10.222.0.70 () {58 vars in 1247 bytes} [Thu Jun 16 19:08:43 2022] GET /compute/v2.1/servers/7a805bc0-29bf-4ca0-80b2-e2ee71912d51/ips => generated 148 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:08:45.280826 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-1ce03892-3b76-4e13-ac57-ae2c9668a54c tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "03ca5ea6-68e8-49cb-9f5c-a96f2261404b"}} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:08:45.283300 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-1ce03892-3b76-4e13-ac57-ae2c9668a54c tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 7a805bc0-29bf-4ca0-80b2-e2ee71912d51] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:45.286333 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_api:SELECT=28 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:08:45.287169 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_cell1:SELECT=86 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:08:45.298930 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-1ce03892-3b76-4e13-ac57-ae2c9668a54c tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:45.299725 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-1ce03892-3b76-4e13-ac57-ae2c9668a54c tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:45.300714 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-1ce03892-3b76-4e13-ac57-ae2c9668a54c tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:45.301425 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-1ce03892-3b76-4e13-ac57-ae2c9668a54c tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:45.593614 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-1ce03892-3b76-4e13-ac57-ae2c9668a54c tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "POST /compute/v2.1/servers/7a805bc0-29bf-4ca0-80b2-e2ee71912d51/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.316454 Jun 16 19:08:45.597669 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 509/1035] 10.222.0.70 () {60 vars in 1322 bytes} [Thu Jun 16 19:08:45 2022] POST /compute/v2.1/servers/7a805bc0-29bf-4ca0-80b2-e2ee71912d51/os-volume_attachments => generated 194 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:08:53.129359 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-d85213d1-d721-47dc-befa-86ce899b4ba1 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Action: 'create', calling method: .version_select at 0x7f12e5e8bca0>, body: {"keypair": {"name": "tempest-keypair-740466503", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCVLdtiWkII3vpW+KC3aIE0cWsxT27vvy1UBHFCgJkmOxOeyJWdv/ZvIpUBHGEri+3BwllfiaiQanpSG4n8VvJaAkm5d4/5v17iL7AeOEFy7Dx4T5GBUC/Hx/gOpcgwvA=="}} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:08:53.144462 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.quota [None req-d85213d1-d721-47dc-befa-86ce899b4ba1 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Getting quotas for project bf39ecb69ea7474d940ad17f8bab4874. Resources: {'key_pairs'} {{(pid=117852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:08:53.148257 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.quota [None req-d85213d1-d721-47dc-befa-86ce899b4ba1 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Getting quotas for user 55f5aba8355c436b94508156bca24ab3 and project bf39ecb69ea7474d940ad17f8bab4874. Resources: {'key_pairs'} {{(pid=117852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:08:53.171376 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-d85213d1-d721-47dc-befa-86ce899b4ba1 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045776 Jun 16 19:08:53.171980 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 527/1036] 10.222.0.70 () {60 vars in 1158 bytes} [Thu Jun 16 19:08:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:08:54.466798 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-a28c0c73-61fd-4529-9091-0c88d44a0169 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1517574524", "imageRef": "1d993e69-7f01-4fe0-ba52-0eae2fa43ddf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "16a4eb33-8dce-42a9-8f45-666580159bfa"}], "security_groups": [{"name": "tempest-securitygroup--2000211524"}], "key_name": "tempest-keypair-740466503", "user_data": "}} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:08:54.587184 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.network.neutron [None req-a28c0c73-61fd-4529-9091-0c88d44a0169 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] validate_networks() for [('16a4eb33-8dce-42a9-8f45-666580159bfa', None, None, None, None, None)] {{(pid=117850) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:08:54.981237 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-a28c0c73-61fd-4529-9091-0c88d44a0169 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Flavor limits 0:0:0 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:08:54.981678 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-a28c0c73-61fd-4529-9091-0c88d44a0169 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Image limits 0:0:0 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:08:54.982150 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-a28c0c73-61fd-4529-9091-0c88d44a0169 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Flavor pref 0:0:0 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:08:54.982579 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-a28c0c73-61fd-4529-9091-0c88d44a0169 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Image pref 0:0:0 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:08:54.983002 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-a28c0c73-61fd-4529-9091-0c88d44a0169 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:08:54.992115 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-a28c0c73-61fd-4529-9091-0c88d44a0169 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:54.992558 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-a28c0c73-61fd-4529-9091-0c88d44a0169 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:54.993861 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-a28c0c73-61fd-4529-9091-0c88d44a0169 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:54.993861 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-a28c0c73-61fd-4529-9091-0c88d44a0169 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:55.013714 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.quota [None req-a28c0c73-61fd-4529-9091-0c88d44a0169 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Getting quotas for project bf39ecb69ea7474d940ad17f8bab4874. Resources: {'cores', 'ram', 'instances'} {{(pid=117850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:08:55.018176 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.quota [None req-a28c0c73-61fd-4529-9091-0c88d44a0169 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Getting quotas for user 55f5aba8355c436b94508156bca24ab3 and project bf39ecb69ea7474d940ad17f8bab4874. Resources: {'cores', 'ram', 'instances'} {{(pid=117850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:08:55.029826 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-a28c0c73-61fd-4529-9091-0c88d44a0169 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Going to run 1 instances... {{(pid=117850) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:08:55.032231 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-a28c0c73-61fd-4529-9091-0c88d44a0169 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: be3da0ff-e131-41df-b0ae-350e3ccd81c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1d993e69-7f01-4fe0-ba52-0eae2fa43ddf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:08:55.087794 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-a28c0c73-61fd-4529-9091-0c88d44a0169 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.625809 Jun 16 19:08:55.088447 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 510/1037] 10.222.0.70 () {60 vars in 1146 bytes} [Thu Jun 16 19:08:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:08:55.096815 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_cell1:SELECT=4 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:08:55.102406 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-c823d237-60cb-4b72-8f37-ef9bf7cec261 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:55.103401 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-c823d237-60cb-4b72-8f37-ef9bf7cec261 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: be3da0ff-e131-41df-b0ae-350e3ccd81c3] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:55.169856 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-c823d237-60cb-4b72-8f37-ef9bf7cec261 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f5aba8355c436b94508156bca24ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf39ecb69ea7474d940ad17f8bab4874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:08:55.179451 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-c823d237-60cb-4b72-8f37-ef9bf7cec261 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/be3da0ff-e131-41df-b0ae-350e3ccd81c3" status: 200 len: 1241 microversion: 2.1 time: 0.083078 Jun 16 19:08:55.180421 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 528/1038] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:55 2022] GET /compute/v2.1/servers/be3da0ff-e131-41df-b0ae-350e3ccd81c3 => generated 1241 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:08:56.198223 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-e48616cb-4912-45b0-821d-eb1239cde95e tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:56.199990 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-e48616cb-4912-45b0-821d-eb1239cde95e tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: be3da0ff-e131-41df-b0ae-350e3ccd81c3] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:56.208352 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-e48616cb-4912-45b0-821d-eb1239cde95e tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:56.208735 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-e48616cb-4912-45b0-821d-eb1239cde95e tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:56.209523 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-e48616cb-4912-45b0-821d-eb1239cde95e tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:56.209967 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-e48616cb-4912-45b0-821d-eb1239cde95e tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:56.286869 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-e48616cb-4912-45b0-821d-eb1239cde95e tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f5aba8355c436b94508156bca24ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf39ecb69ea7474d940ad17f8bab4874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:08:56.295475 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-e48616cb-4912-45b0-821d-eb1239cde95e tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/be3da0ff-e131-41df-b0ae-350e3ccd81c3" status: 200 len: 1301 microversion: 2.1 time: 0.101856 Jun 16 19:08:56.296259 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 511/1039] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:56 2022] GET /compute/v2.1/servers/be3da0ff-e131-41df-b0ae-350e3ccd81c3 => generated 1301 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:08:57.313150 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-1d5c873b-4508-42ad-acc5-f58cea4b1826 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:57.313793 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-1d5c873b-4508-42ad-acc5-f58cea4b1826 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: be3da0ff-e131-41df-b0ae-350e3ccd81c3] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:57.320300 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-1d5c873b-4508-42ad-acc5-f58cea4b1826 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:57.320757 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-1d5c873b-4508-42ad-acc5-f58cea4b1826 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:57.321529 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-1d5c873b-4508-42ad-acc5-f58cea4b1826 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:57.321974 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-1d5c873b-4508-42ad-acc5-f58cea4b1826 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:57.471048 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-1d5c873b-4508-42ad-acc5-f58cea4b1826 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f5aba8355c436b94508156bca24ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf39ecb69ea7474d940ad17f8bab4874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:08:57.479646 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-1d5c873b-4508-42ad-acc5-f58cea4b1826 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/be3da0ff-e131-41df-b0ae-350e3ccd81c3" status: 200 len: 1367 microversion: 2.1 time: 0.170459 Jun 16 19:08:57.480369 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 529/1040] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:57 2022] GET /compute/v2.1/servers/be3da0ff-e131-41df-b0ae-350e3ccd81c3 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:08:57.643408 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [req-12c8ac36-de11-4d22-8b9b-cebd7ddd6fc0 req-8e44ab45-3aa2-4308-a674-3594088ef672 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be3da0ff-e131-41df-b0ae-350e3ccd81c3", "tag": "0bc2f283-44e8-4edd-96ab-5bb74e4fbc3d"}]} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:08:57.656467 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-12c8ac36-de11-4d22-8b9b-cebd7ddd6fc0 req-8e44ab45-3aa2-4308-a674-3594088ef672 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:57.657236 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-12c8ac36-de11-4d22-8b9b-cebd7ddd6fc0 req-8e44ab45-3aa2-4308-a674-3594088ef672 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:57.675160 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.compute.server_external_events [req-12c8ac36-de11-4d22-8b9b-cebd7ddd6fc0 req-8e44ab45-3aa2-4308-a674-3594088ef672 service nova] Creating event network-changed:0bc2f283-44e8-4edd-96ab-5bb74e4fbc3d for instance be3da0ff-e131-41df-b0ae-350e3ccd81c3 on hv-cinder-84617 Jun 16 19:08:57.681042 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [req-12c8ac36-de11-4d22-8b9b-cebd7ddd6fc0 req-8e44ab45-3aa2-4308-a674-3594088ef672 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041903 Jun 16 19:08:57.681946 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 512/1041] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:08:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:08:58.497300 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-07028e09-7acb-4274-a724-6b490c1f9741 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:58.497901 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-07028e09-7acb-4274-a724-6b490c1f9741 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: be3da0ff-e131-41df-b0ae-350e3ccd81c3] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:58.505578 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-07028e09-7acb-4274-a724-6b490c1f9741 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:58.506033 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-07028e09-7acb-4274-a724-6b490c1f9741 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:58.506866 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-07028e09-7acb-4274-a724-6b490c1f9741 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:58.507327 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-07028e09-7acb-4274-a724-6b490c1f9741 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:58.642925 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-07028e09-7acb-4274-a724-6b490c1f9741 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f5aba8355c436b94508156bca24ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf39ecb69ea7474d940ad17f8bab4874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:08:58.650322 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-07028e09-7acb-4274-a724-6b490c1f9741 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/be3da0ff-e131-41df-b0ae-350e3ccd81c3" status: 200 len: 1367 microversion: 2.1 time: 0.157092 Jun 16 19:08:58.651176 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 530/1042] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:58 2022] GET /compute/v2.1/servers/be3da0ff-e131-41df-b0ae-350e3ccd81c3 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:08:59.669309 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-2dff129a-83c7-464c-8e19-826d4fd80b60 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:08:59.670008 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-2dff129a-83c7-464c-8e19-826d4fd80b60 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: be3da0ff-e131-41df-b0ae-350e3ccd81c3] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:08:59.676261 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-2dff129a-83c7-464c-8e19-826d4fd80b60 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:59.676714 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-2dff129a-83c7-464c-8e19-826d4fd80b60 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:59.677475 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-2dff129a-83c7-464c-8e19-826d4fd80b60 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:08:59.677912 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-2dff129a-83c7-464c-8e19-826d4fd80b60 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:08:59.806678 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-2dff129a-83c7-464c-8e19-826d4fd80b60 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f5aba8355c436b94508156bca24ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf39ecb69ea7474d940ad17f8bab4874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:08:59.814672 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-2dff129a-83c7-464c-8e19-826d4fd80b60 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/be3da0ff-e131-41df-b0ae-350e3ccd81c3" status: 200 len: 1367 microversion: 2.1 time: 0.150076 Jun 16 19:08:59.815238 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 513/1043] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:08:59 2022] GET /compute/v2.1/servers/be3da0ff-e131-41df-b0ae-350e3ccd81c3 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:09:00.832038 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-1a5d059d-f697-4a63-aa08-5771c8af048c tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:09:00.832655 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-1a5d059d-f697-4a63-aa08-5771c8af048c tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: be3da0ff-e131-41df-b0ae-350e3ccd81c3] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:09:00.839521 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-1a5d059d-f697-4a63-aa08-5771c8af048c tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:00.839977 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-1a5d059d-f697-4a63-aa08-5771c8af048c tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:00.841509 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-1a5d059d-f697-4a63-aa08-5771c8af048c tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:00.841949 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-1a5d059d-f697-4a63-aa08-5771c8af048c tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:00.972123 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-1a5d059d-f697-4a63-aa08-5771c8af048c tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f5aba8355c436b94508156bca24ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf39ecb69ea7474d940ad17f8bab4874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:09:00.979540 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-1a5d059d-f697-4a63-aa08-5771c8af048c tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/be3da0ff-e131-41df-b0ae-350e3ccd81c3" status: 200 len: 1367 microversion: 2.1 time: 0.151613 Jun 16 19:09:00.980108 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 531/1044] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:09:00 2022] GET /compute/v2.1/servers/be3da0ff-e131-41df-b0ae-350e3ccd81c3 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:09:01.997952 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-4216586b-ce11-4325-9711-845999301f9f tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:09:01.998623 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-4216586b-ce11-4325-9711-845999301f9f tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: be3da0ff-e131-41df-b0ae-350e3ccd81c3] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:09:02.007563 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-4216586b-ce11-4325-9711-845999301f9f tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:02.008017 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-4216586b-ce11-4325-9711-845999301f9f tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:02.008781 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-4216586b-ce11-4325-9711-845999301f9f tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:02.009212 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-4216586b-ce11-4325-9711-845999301f9f tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:02.143208 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-4216586b-ce11-4325-9711-845999301f9f tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f5aba8355c436b94508156bca24ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf39ecb69ea7474d940ad17f8bab4874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:09:02.150586 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-4216586b-ce11-4325-9711-845999301f9f tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/be3da0ff-e131-41df-b0ae-350e3ccd81c3" status: 200 len: 1367 microversion: 2.1 time: 0.156900 Jun 16 19:09:02.151405 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 514/1045] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:09:01 2022] GET /compute/v2.1/servers/be3da0ff-e131-41df-b0ae-350e3ccd81c3 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:09:03.167974 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-31e4d387-cefa-482d-ab3d-02c1f41d67a5 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:09:03.168592 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-31e4d387-cefa-482d-ab3d-02c1f41d67a5 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: be3da0ff-e131-41df-b0ae-350e3ccd81c3] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:09:03.176363 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-31e4d387-cefa-482d-ab3d-02c1f41d67a5 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:03.176997 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-31e4d387-cefa-482d-ab3d-02c1f41d67a5 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:03.178199 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-31e4d387-cefa-482d-ab3d-02c1f41d67a5 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:03.179013 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-31e4d387-cefa-482d-ab3d-02c1f41d67a5 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:03.314672 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-31e4d387-cefa-482d-ab3d-02c1f41d67a5 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f5aba8355c436b94508156bca24ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf39ecb69ea7474d940ad17f8bab4874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:09:03.321964 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-31e4d387-cefa-482d-ab3d-02c1f41d67a5 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/be3da0ff-e131-41df-b0ae-350e3ccd81c3" status: 200 len: 1367 microversion: 2.1 time: 0.157897 Jun 16 19:09:03.322517 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 532/1046] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:09:03 2022] GET /compute/v2.1/servers/be3da0ff-e131-41df-b0ae-350e3ccd81c3 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:09:04.339658 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-4838d3dd-3da2-4ff4-b3b9-17ba7a94e9f0 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:09:04.340190 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-4838d3dd-3da2-4ff4-b3b9-17ba7a94e9f0 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: be3da0ff-e131-41df-b0ae-350e3ccd81c3] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:09:04.348120 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-4838d3dd-3da2-4ff4-b3b9-17ba7a94e9f0 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:04.348649 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-4838d3dd-3da2-4ff4-b3b9-17ba7a94e9f0 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:04.349535 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-4838d3dd-3da2-4ff4-b3b9-17ba7a94e9f0 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:04.350065 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-4838d3dd-3da2-4ff4-b3b9-17ba7a94e9f0 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:04.487332 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-4838d3dd-3da2-4ff4-b3b9-17ba7a94e9f0 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f5aba8355c436b94508156bca24ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf39ecb69ea7474d940ad17f8bab4874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:09:04.495342 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-4838d3dd-3da2-4ff4-b3b9-17ba7a94e9f0 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/be3da0ff-e131-41df-b0ae-350e3ccd81c3" status: 200 len: 1367 microversion: 2.1 time: 0.159514 Jun 16 19:09:04.495923 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 515/1047] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:09:04 2022] GET /compute/v2.1/servers/be3da0ff-e131-41df-b0ae-350e3ccd81c3 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:09:04.511530 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [req-dac09239-056f-4e23-8f86-5f9e324bb77e req-082bade0-c01f-4bd2-a3f3-21a005c052e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be3da0ff-e131-41df-b0ae-350e3ccd81c3", "name": "network-vif-plugged", "status": "completed", "tag": "0bc2f283-44e8-4edd-96ab-5bb74e4fbc3d"}]} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:09:04.521620 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-dac09239-056f-4e23-8f86-5f9e324bb77e req-082bade0-c01f-4bd2-a3f3-21a005c052e3 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:04.522183 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-dac09239-056f-4e23-8f86-5f9e324bb77e req-082bade0-c01f-4bd2-a3f3-21a005c052e3 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:04.535265 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.compute.server_external_events [req-dac09239-056f-4e23-8f86-5f9e324bb77e req-082bade0-c01f-4bd2-a3f3-21a005c052e3 service nova] Creating event network-vif-plugged:0bc2f283-44e8-4edd-96ab-5bb74e4fbc3d for instance be3da0ff-e131-41df-b0ae-350e3ccd81c3 on hv-cinder-84617 Jun 16 19:09:04.540438 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [req-dac09239-056f-4e23-8f86-5f9e324bb77e req-082bade0-c01f-4bd2-a3f3-21a005c052e3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032821 Jun 16 19:09:04.541029 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 533/1048] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:09:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:09:05.513350 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-e9d582d6-11bb-48b3-a4e6-2db3a6e3e972 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:09:05.513827 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-e9d582d6-11bb-48b3-a4e6-2db3a6e3e972 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: be3da0ff-e131-41df-b0ae-350e3ccd81c3] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:09:05.515865 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_cell0:SELECT=2 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:09:05.516518 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_cell0:SELECT=6 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:09:05.523578 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-e9d582d6-11bb-48b3-a4e6-2db3a6e3e972 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:05.524035 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-e9d582d6-11bb-48b3-a4e6-2db3a6e3e972 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:05.524929 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-e9d582d6-11bb-48b3-a4e6-2db3a6e3e972 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:05.525373 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-e9d582d6-11bb-48b3-a4e6-2db3a6e3e972 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:05.652766 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-e9d582d6-11bb-48b3-a4e6-2db3a6e3e972 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f5aba8355c436b94508156bca24ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf39ecb69ea7474d940ad17f8bab4874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:09:05.661401 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-e9d582d6-11bb-48b3-a4e6-2db3a6e3e972 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/be3da0ff-e131-41df-b0ae-350e3ccd81c3" status: 200 len: 1367 microversion: 2.1 time: 0.151631 Jun 16 19:09:05.661606 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 516/1049] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:09:05 2022] GET /compute/v2.1/servers/be3da0ff-e131-41df-b0ae-350e3ccd81c3 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:09:06.679241 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-d89da72a-d6e9-4ea1-bd9e-e8b2894f647d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:09:06.679861 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-d89da72a-d6e9-4ea1-bd9e-e8b2894f647d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: be3da0ff-e131-41df-b0ae-350e3ccd81c3] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:09:06.681859 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_cell0:SELECT=6 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:09:06.688865 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d89da72a-d6e9-4ea1-bd9e-e8b2894f647d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:06.689307 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d89da72a-d6e9-4ea1-bd9e-e8b2894f647d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:06.690065 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d89da72a-d6e9-4ea1-bd9e-e8b2894f647d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:06.690494 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d89da72a-d6e9-4ea1-bd9e-e8b2894f647d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:06.822385 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-d89da72a-d6e9-4ea1-bd9e-e8b2894f647d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f5aba8355c436b94508156bca24ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf39ecb69ea7474d940ad17f8bab4874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:09:06.829996 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-d89da72a-d6e9-4ea1-bd9e-e8b2894f647d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/be3da0ff-e131-41df-b0ae-350e3ccd81c3" status: 200 len: 1556 microversion: 2.1 time: 0.155041 Jun 16 19:09:06.830552 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 534/1050] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:09:06 2022] GET /compute/v2.1/servers/be3da0ff-e131-41df-b0ae-350e3ccd81c3 => generated 1556 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:09:06.846430 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-1fc86b3c-b16c-4157-96b4-093ab5cc49d0 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:09:06.847032 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-1fc86b3c-b16c-4157-96b4-093ab5cc49d0 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: be3da0ff-e131-41df-b0ae-350e3ccd81c3] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:09:06.853403 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-1fc86b3c-b16c-4157-96b4-093ab5cc49d0 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:06.853849 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-1fc86b3c-b16c-4157-96b4-093ab5cc49d0 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:06.854622 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-1fc86b3c-b16c-4157-96b4-093ab5cc49d0 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:06.855057 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-1fc86b3c-b16c-4157-96b4-093ab5cc49d0 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:06.931089 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-1fc86b3c-b16c-4157-96b4-093ab5cc49d0 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/be3da0ff-e131-41df-b0ae-350e3ccd81c3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088434 Jun 16 19:09:06.931619 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 517/1051] 10.222.0.70 () {58 vars in 1274 bytes} [Thu Jun 16 19:09:06 2022] GET /compute/v2.1/servers/be3da0ff-e131-41df-b0ae-350e3ccd81c3/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:09:08.099398 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [req-a5e21f97-ca40-4ef4-ad4c-44a9d65d381b req-5118f0ca-18c7-4f41-9682-14a2c691de18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be3da0ff-e131-41df-b0ae-350e3ccd81c3", "tag": "0bc2f283-44e8-4edd-96ab-5bb74e4fbc3d"}]} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:09:08.109043 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-a5e21f97-ca40-4ef4-ad4c-44a9d65d381b req-5118f0ca-18c7-4f41-9682-14a2c691de18 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:08.109498 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-a5e21f97-ca40-4ef4-ad4c-44a9d65d381b req-5118f0ca-18c7-4f41-9682-14a2c691de18 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:08.121307 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.compute.server_external_events [req-a5e21f97-ca40-4ef4-ad4c-44a9d65d381b req-5118f0ca-18c7-4f41-9682-14a2c691de18 service nova] Creating event network-changed:0bc2f283-44e8-4edd-96ab-5bb74e4fbc3d for instance be3da0ff-e131-41df-b0ae-350e3ccd81c3 on hv-cinder-84617 Jun 16 19:09:08.127036 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [req-a5e21f97-ca40-4ef4-ad4c-44a9d65d381b req-5118f0ca-18c7-4f41-9682-14a2c691de18 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031388 Jun 16 19:09:08.128011 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 535/1052] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:09:44.287695 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:09:44.288444 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:09:44.293166 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-f15b966a-d0c6-4c2f-8fca-658249a9d09f tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:09:44.293666 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-f15b966a-d0c6-4c2f-8fca-658249a9d09f tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: be3da0ff-e131-41df-b0ae-350e3ccd81c3] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:09:44.301297 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-f15b966a-d0c6-4c2f-8fca-658249a9d09f tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:44.302316 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-f15b966a-d0c6-4c2f-8fca-658249a9d09f tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:44.302948 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-f15b966a-d0c6-4c2f-8fca-658249a9d09f tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:44.303375 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-f15b966a-d0c6-4c2f-8fca-658249a9d09f tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:44.328371 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-f15b966a-d0c6-4c2f-8fca-658249a9d09f tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/be3da0ff-e131-41df-b0ae-350e3ccd81c3/ips" status: 200 len: 149 microversion: 2.1 time: 0.042683 Jun 16 19:09:44.329023 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 518/1053] 10.222.0.70 () {58 vars in 1247 bytes} [Thu Jun 16 19:09:44 2022] GET /compute/v2.1/servers/be3da0ff-e131-41df-b0ae-350e3ccd81c3/ips => generated 149 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:09:44.341123 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-6ff187af-2ac2-458a-b2b2-91c0a13ab87b tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "03ca5ea6-68e8-49cb-9f5c-a96f2261404b"}} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:09:44.342258 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-6ff187af-2ac2-458a-b2b2-91c0a13ab87b tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: be3da0ff-e131-41df-b0ae-350e3ccd81c3] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:09:44.344422 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:09:44.345052 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_cell1:SELECT=34 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:09:44.351674 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-6ff187af-2ac2-458a-b2b2-91c0a13ab87b tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:44.352122 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-6ff187af-2ac2-458a-b2b2-91c0a13ab87b tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:44.352880 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-6ff187af-2ac2-458a-b2b2-91c0a13ab87b tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:44.353311 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-6ff187af-2ac2-458a-b2b2-91c0a13ab87b tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:44.586655 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.wsgi [None req-6ff187af-2ac2-458a-b2b2-91c0a13ab87b tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] HTTP exception thrown: Invalid volume: volume 03ca5ea6-68e8-49cb-9f5c-a96f2261404b is already attached to instances: 7a805bc0-29bf-4ca0-80b2-e2ee71912d51 Jun 16 19:09:44.588383 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-6ff187af-2ac2-458a-b2b2-91c0a13ab87b tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Request method failure captured: Jun 16 19:09:44.588383 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: request: POST /compute/v2.1/servers/be3da0ff-e131-41df-b0ae-350e3ccd81c3/os-volume_attachments HTTP/1.1 Jun 16 19:09:44.588383 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Accept: application/json Jun 16 19:09:44.588383 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Accept-Encoding: identity Jun 16 19:09:44.588383 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Connection: close Jun 16 19:09:44.588383 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Content-Length: 74 Jun 16 19:09:44.588383 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Content-Type: application/json Jun 16 19:09:44.588383 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Host: 10.222.0.70 Jun 16 19:09:44.588383 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Openstack-System-Scope: None Jun 16 19:09:44.588383 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: User-Agent: python-urllib3/1.26.9 Jun 16 19:09:44.588383 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Auth-Token: gAAAAABiq397T4ON-zQSBMJgTjz79-0rWbCf9bpfcP8v-Jb0yUpscjKugrXoi0b22yw1HJ_i1bTu9MeeX2PCjDS1AXbAoxSR6e2OSDrQ63ej8My_EvvhndYrxtwl3jqGomk9A-ziExtrOqReYSW9IwopSACLPtaotkV-uvvWqsg4A20E92OPpA0 Jun 16 19:09:44.588383 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Domain-Id: None Jun 16 19:09:44.588383 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Domain-Name: None Jun 16 19:09:44.588383 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Identity-Status: Confirmed Jun 16 19:09:44.588383 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Is-Admin-Project: True Jun 16 19:09:44.588383 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Domain-Id: default Jun 16 19:09:44.588383 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Domain-Name: Default Jun 16 19:09:44.588383 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Id: bf39ecb69ea7474d940ad17f8bab4874 Jun 16 19:09:44.588383 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Name: tempest-AttachVolumeNegativeTest-1452215888 Jun 16 19:09:44.588383 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Role: member,reader Jun 16 19:09:44.588383 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Roles: member,reader Jun 16 19:09:44.590039 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/bf39ecb69ea7474d940ad17f8bab4874"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_bf39ecb69ea7474d940ad17f8bab4874", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/bf39ecb69ea7474d940ad17f8bab4874"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/bf39ecb69ea7474d940ad17f8bab4874"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 16 19:09:44.590039 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant: tempest-AttachVolumeNegativeTest-1452215888 Jun 16 19:09:44.590039 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant-Id: bf39ecb69ea7474d940ad17f8bab4874 Jun 16 19:09:44.590039 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1452215888 Jun 16 19:09:44.590039 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User: tempest-AttachVolumeNegativeTest-1452215888-project Jun 16 19:09:44.590039 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Domain-Id: default Jun 16 19:09:44.590039 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Domain-Name: Default Jun 16 19:09:44.590039 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Id: 55f5aba8355c436b94508156bca24ab3 Jun 16 19:09:44.590039 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Name: tempest-AttachVolumeNegativeTest-1452215888-project Jun 16 19:09:44.590039 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Jun 16 19:09:44.590039 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: {"volumeAttachment": {"volumeId": "03ca5ea6-68e8-49cb-9f5c-a96f2261404b"}} Jun 16 19:09:44.590039 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: method: > Jun 16 19:09:44.591242 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: exception: Invalid volume: volume 03ca5ea6-68e8-49cb-9f5c-a96f2261404b is already attached to instances: 7a805bc0-29bf-4ca0-80b2-e2ee71912d51 Jun 16 19:09:44.591242 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: action_args: {'server_id': 'be3da0ff-e131-41df-b0ae-350e3ccd81c3', 'body': {'volumeAttachment': {'volumeId': '03ca5ea6-68e8-49cb-9f5c-a96f2261404b'}}} Jun 16 19:09:44.591242 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:09:44.591242 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:09:44.591242 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 16 19:09:44.591242 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 16 19:09:44.591242 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 19:09:44.591242 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 19:09:44.591242 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 16 19:09:44.591242 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 16 19:09:44.591242 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 16 19:09:44.591242 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 16 19:09:44.591242 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 16 19:09:44.591242 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 16 19:09:44.591242 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 03ca5ea6-68e8-49cb-9f5c-a96f2261404b is already attached to instances: 7a805bc0-29bf-4ca0-80b2-e2ee71912d51 Jun 16 19:09:44.591242 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:09:44.591242 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:09:44.591242 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:09:44.591242 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:09:44.592790 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:09:44.592790 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:09:44.592790 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:09:44.592790 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:09:44.592790 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:09:44.592790 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:09:44.592790 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 19:09:44.592790 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 19:09:44.592790 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 19:09:44.592790 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 19:09:44.592790 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 19:09:44.592790 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 19:09:44.592790 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 16 19:09:44.592790 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 16 19:09:44.592790 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 03ca5ea6-68e8-49cb-9f5c-a96f2261404b is already attached to instances: 7a805bc0-29bf-4ca0-80b2-e2ee71912d51 Jun 16 19:09:44.592790 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:09:44.592790 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:09:44.592790 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:09:44.592790 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:09:44.592790 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:09:44.594389 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:09:44.594389 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:09:44.594389 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:09:44.594389 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 03ca5ea6-68e8-49cb-9f5c-a96f2261404b is already attached to instances: 7a805bc0-29bf-4ca0-80b2-e2ee71912d51 Jun 16 19:09:44.594389 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:09:44.594389 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-6ff187af-2ac2-458a-b2b2-91c0a13ab87b tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Returning 400 to user: Invalid volume: volume 03ca5ea6-68e8-49cb-9f5c-a96f2261404b is already attached to instances: 7a805bc0-29bf-4ca0-80b2-e2ee71912d51 {{(pid=117852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:09:44.594389 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-6ff187af-2ac2-458a-b2b2-91c0a13ab87b tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "POST /compute/v2.1/servers/be3da0ff-e131-41df-b0ae-350e3ccd81c3/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.253326 Jun 16 19:09:44.594389 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 536/1054] 10.222.0.70 () {60 vars in 1322 bytes} [Thu Jun 16 19:09:44 2022] POST /compute/v2.1/servers/be3da0ff-e131-41df-b0ae-350e3ccd81c3/os-volume_attachments => generated 174 bytes in 255 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 19:09:44.598930 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-12b97863-7941-4ee1-a44b-01dcd0d5bf7a tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:09:44.599437 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-12b97863-7941-4ee1-a44b-01dcd0d5bf7a tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: be3da0ff-e131-41df-b0ae-350e3ccd81c3] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:09:44.606529 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-12b97863-7941-4ee1-a44b-01dcd0d5bf7a tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:44.607031 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-12b97863-7941-4ee1-a44b-01dcd0d5bf7a tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:44.607805 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-12b97863-7941-4ee1-a44b-01dcd0d5bf7a tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:44.608247 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-12b97863-7941-4ee1-a44b-01dcd0d5bf7a tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:44.634891 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-12b97863-7941-4ee1-a44b-01dcd0d5bf7a tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: be3da0ff-e131-41df-b0ae-350e3ccd81c3] Going to try to terminate instance {{(pid=117850) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:09:44.717449 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-12b97863-7941-4ee1-a44b-01dcd0d5bf7a tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "DELETE /compute/v2.1/servers/be3da0ff-e131-41df-b0ae-350e3ccd81c3" status: 204 len: 0 microversion: 2.1 time: 0.122165 Jun 16 19:09:44.718286 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 519/1055] 10.222.0.70 () {58 vars in 1238 bytes} [Thu Jun 16 19:09:44 2022] DELETE /compute/v2.1/servers/be3da0ff-e131-41df-b0ae-350e3ccd81c3 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 19:09:44.727532 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-1fae23a0-6b80-48be-a36e-ac8a1e6b9276 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:09:44.728145 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-1fae23a0-6b80-48be-a36e-ac8a1e6b9276 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: be3da0ff-e131-41df-b0ae-350e3ccd81c3] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:09:44.735033 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-1fae23a0-6b80-48be-a36e-ac8a1e6b9276 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:44.735483 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-1fae23a0-6b80-48be-a36e-ac8a1e6b9276 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:44.736243 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-1fae23a0-6b80-48be-a36e-ac8a1e6b9276 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:44.736677 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-1fae23a0-6b80-48be-a36e-ac8a1e6b9276 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:44.871250 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-1fae23a0-6b80-48be-a36e-ac8a1e6b9276 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f5aba8355c436b94508156bca24ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf39ecb69ea7474d940ad17f8bab4874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:09:44.878648 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-1fae23a0-6b80-48be-a36e-ac8a1e6b9276 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/be3da0ff-e131-41df-b0ae-350e3ccd81c3" status: 200 len: 1681 microversion: 2.1 time: 0.156134 Jun 16 19:09:44.879200 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 537/1056] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:09:44 2022] GET /compute/v2.1/servers/be3da0ff-e131-41df-b0ae-350e3ccd81c3 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:09:45.897183 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-bf6d7330-9e3c-4f93-8382-5d0069e64a95 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:09:45.897984 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-bf6d7330-9e3c-4f93-8382-5d0069e64a95 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: be3da0ff-e131-41df-b0ae-350e3ccd81c3] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:09:45.905012 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-bf6d7330-9e3c-4f93-8382-5d0069e64a95 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:45.905460 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-bf6d7330-9e3c-4f93-8382-5d0069e64a95 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:45.906224 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-bf6d7330-9e3c-4f93-8382-5d0069e64a95 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:45.906686 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-bf6d7330-9e3c-4f93-8382-5d0069e64a95 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:46.147573 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-bf6d7330-9e3c-4f93-8382-5d0069e64a95 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f5aba8355c436b94508156bca24ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf39ecb69ea7474d940ad17f8bab4874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:09:46.155654 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-bf6d7330-9e3c-4f93-8382-5d0069e64a95 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/be3da0ff-e131-41df-b0ae-350e3ccd81c3" status: 200 len: 1681 microversion: 2.1 time: 0.263182 Jun 16 19:09:46.156224 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 520/1057] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:09:45 2022] GET /compute/v2.1/servers/be3da0ff-e131-41df-b0ae-350e3ccd81c3 => generated 1681 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:09:47.122690 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [req-e980270a-66e9-4cda-8be7-a959e07c018e req-72617d9d-2e46-4c66-add3-e020fc3f810d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be3da0ff-e131-41df-b0ae-350e3ccd81c3", "name": "network-vif-deleted", "tag": "0bc2f283-44e8-4edd-96ab-5bb74e4fbc3d"}]} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:09:47.132026 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-e980270a-66e9-4cda-8be7-a959e07c018e req-72617d9d-2e46-4c66-add3-e020fc3f810d service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:47.132479 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-e980270a-66e9-4cda-8be7-a959e07c018e req-72617d9d-2e46-4c66-add3-e020fc3f810d service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:47.146069 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.compute.server_external_events [req-e980270a-66e9-4cda-8be7-a959e07c018e req-72617d9d-2e46-4c66-add3-e020fc3f810d service nova] Creating event network-vif-deleted:0bc2f283-44e8-4edd-96ab-5bb74e4fbc3d for instance be3da0ff-e131-41df-b0ae-350e3ccd81c3 on hv-cinder-84617 Jun 16 19:09:47.152202 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [req-e980270a-66e9-4cda-8be7-a959e07c018e req-72617d9d-2e46-4c66-add3-e020fc3f810d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032822 Jun 16 19:09:47.153010 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 538/1058] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:09:47.178041 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-3e3abe53-3b03-4d27-8423-9b966216132b tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:09:47.179741 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-3e3abe53-3b03-4d27-8423-9b966216132b tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: be3da0ff-e131-41df-b0ae-350e3ccd81c3] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:09:47.189183 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-3e3abe53-3b03-4d27-8423-9b966216132b tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:47.195724 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-3e3abe53-3b03-4d27-8423-9b966216132b tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:47.199377 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-3e3abe53-3b03-4d27-8423-9b966216132b tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:47.200428 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-3e3abe53-3b03-4d27-8423-9b966216132b tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:47.284602 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-3e3abe53-3b03-4d27-8423-9b966216132b tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f5aba8355c436b94508156bca24ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf39ecb69ea7474d940ad17f8bab4874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:09:47.293635 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-3e3abe53-3b03-4d27-8423-9b966216132b tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/be3da0ff-e131-41df-b0ae-350e3ccd81c3" status: 200 len: 1326 microversion: 2.1 time: 0.123940 Jun 16 19:09:47.294276 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 521/1059] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:09:47 2022] GET /compute/v2.1/servers/be3da0ff-e131-41df-b0ae-350e3ccd81c3 => generated 1326 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:09:48.275931 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 19:09:48.276949 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Thu Jun 16 19:09:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 19:09:48.312795 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-86840cf6-5391-40f3-93ed-e8a73009fcaf tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:09:48.313420 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-86840cf6-5391-40f3-93ed-e8a73009fcaf tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: be3da0ff-e131-41df-b0ae-350e3ccd81c3] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:09:48.320534 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-86840cf6-5391-40f3-93ed-e8a73009fcaf tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:48.320991 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-86840cf6-5391-40f3-93ed-e8a73009fcaf tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:48.321765 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-86840cf6-5391-40f3-93ed-e8a73009fcaf tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:48.322204 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-86840cf6-5391-40f3-93ed-e8a73009fcaf tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:48.336506 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.wsgi [None req-86840cf6-5391-40f3-93ed-e8a73009fcaf tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] HTTP exception thrown: Instance be3da0ff-e131-41df-b0ae-350e3ccd81c3 could not be found. Jun 16 19:09:48.338216 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-86840cf6-5391-40f3-93ed-e8a73009fcaf tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Request method failure captured: Jun 16 19:09:48.338216 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: request: GET /compute/v2.1/servers/be3da0ff-e131-41df-b0ae-350e3ccd81c3 HTTP/1.1 Jun 16 19:09:48.338216 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Accept: application/json Jun 16 19:09:48.338216 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Accept-Encoding: identity Jun 16 19:09:48.338216 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Connection: close Jun 16 19:09:48.338216 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Content-Length: 0 Jun 16 19:09:48.338216 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Content-Type: application/json Jun 16 19:09:48.338216 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Host: 10.222.0.70 Jun 16 19:09:48.338216 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Openstack-System-Scope: None Jun 16 19:09:48.338216 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: User-Agent: python-urllib3/1.26.9 Jun 16 19:09:48.338216 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Auth-Token: gAAAAABiq397T4ON-zQSBMJgTjz79-0rWbCf9bpfcP8v-Jb0yUpscjKugrXoi0b22yw1HJ_i1bTu9MeeX2PCjDS1AXbAoxSR6e2OSDrQ63ej8My_EvvhndYrxtwl3jqGomk9A-ziExtrOqReYSW9IwopSACLPtaotkV-uvvWqsg4A20E92OPpA0 Jun 16 19:09:48.338216 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Domain-Id: None Jun 16 19:09:48.338216 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Domain-Name: None Jun 16 19:09:48.338216 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Identity-Status: Confirmed Jun 16 19:09:48.338216 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Is-Admin-Project: True Jun 16 19:09:48.338216 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Domain-Id: default Jun 16 19:09:48.338216 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Domain-Name: Default Jun 16 19:09:48.338216 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Id: bf39ecb69ea7474d940ad17f8bab4874 Jun 16 19:09:48.338216 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Name: tempest-AttachVolumeNegativeTest-1452215888 Jun 16 19:09:48.338216 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Role: member,reader Jun 16 19:09:48.338216 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Roles: member,reader Jun 16 19:09:48.340030 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/bf39ecb69ea7474d940ad17f8bab4874"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_bf39ecb69ea7474d940ad17f8bab4874", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/bf39ecb69ea7474d940ad17f8bab4874"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/bf39ecb69ea7474d940ad17f8bab4874"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 16 19:09:48.340030 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant: tempest-AttachVolumeNegativeTest-1452215888 Jun 16 19:09:48.340030 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant-Id: bf39ecb69ea7474d940ad17f8bab4874 Jun 16 19:09:48.340030 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1452215888 Jun 16 19:09:48.340030 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User: tempest-AttachVolumeNegativeTest-1452215888-project Jun 16 19:09:48.340030 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Domain-Id: default Jun 16 19:09:48.340030 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Domain-Name: Default Jun 16 19:09:48.340030 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Id: 55f5aba8355c436b94508156bca24ab3 Jun 16 19:09:48.340030 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Name: tempest-AttachVolumeNegativeTest-1452215888-project Jun 16 19:09:48.340030 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: method: > Jun 16 19:09:48.340030 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: exception: Instance be3da0ff-e131-41df-b0ae-350e3ccd81c3 could not be found. Jun 16 19:09:48.340030 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: action_args: {'id': 'be3da0ff-e131-41df-b0ae-350e3ccd81c3'} Jun 16 19:09:48.340902 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:09:48.340902 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:09:48.340902 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:09:48.340902 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:09:48.340902 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:09:48.340902 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:09:48.340902 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:09:48.340902 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:09:48.340902 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:09:48.340902 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:09:48.340902 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be3da0ff-e131-41df-b0ae-350e3ccd81c3 could not be found. Jun 16 19:09:48.340902 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:09:48.340902 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:09:48.340902 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:09:48.340902 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:09:48.340902 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:09:48.340902 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:09:48.340902 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:09:48.340902 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:09:48.340902 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:09:48.342467 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:09:48.342467 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:09:48.342467 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:09:48.342467 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:09:48.342467 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:09:48.342467 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:09:48.342467 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:09:48.342467 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be3da0ff-e131-41df-b0ae-350e3ccd81c3 could not be found. Jun 16 19:09:48.342467 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:09:48.342467 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:09:48.342467 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:09:48.342467 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:09:48.342467 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:09:48.342467 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:09:48.342467 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:09:48.342467 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:09:48.342467 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be3da0ff-e131-41df-b0ae-350e3ccd81c3 could not be found. Jun 16 19:09:48.342467 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:09:48.343792 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-86840cf6-5391-40f3-93ed-e8a73009fcaf tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Returning 404 to user: Instance be3da0ff-e131-41df-b0ae-350e3ccd81c3 could not be found. {{(pid=117852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:09:48.343792 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-86840cf6-5391-40f3-93ed-e8a73009fcaf tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/be3da0ff-e131-41df-b0ae-350e3ccd81c3" status: 404 len: 111 microversion: 2.1 time: 0.031748 Jun 16 19:09:48.343792 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 539/1060] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:09:48 2022] GET /compute/v2.1/servers/be3da0ff-e131-41df-b0ae-350e3ccd81c3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:09:48.348606 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-a24d290e-62f4-4b74-939f-6f7373b2a036 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '.version_select at 0x7f12e693b040>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:09:48.369168 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-a24d290e-62f4-4b74-939f-6f7373b2a036 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-740466503" status: 202 len: 0 microversion: 2.1 time: 0.024353 Jun 16 19:09:48.369716 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 522/1061] 10.222.0.70 () {58 vars in 1217 bytes} [Thu Jun 16 19:09:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-740466503 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:09:49.030899 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-e7254027-3eca-4643-bf1c-339ac210a362 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:09:49.031430 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-e7254027-3eca-4643-bf1c-339ac210a362 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 7a805bc0-29bf-4ca0-80b2-e2ee71912d51] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:09:49.037824 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-e7254027-3eca-4643-bf1c-339ac210a362 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:49.038275 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-e7254027-3eca-4643-bf1c-339ac210a362 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:49.039088 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-e7254027-3eca-4643-bf1c-339ac210a362 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:49.039643 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-e7254027-3eca-4643-bf1c-339ac210a362 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:49.123600 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.objects.instance [None req-e7254027-3eca-4643-bf1c-339ac210a362 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lazy-loading 'services' on Instance uuid 7a805bc0-29bf-4ca0-80b2-e2ee71912d51 {{(pid=117852) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:09:49.198143 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-e7254027-3eca-4643-bf1c-339ac210a362 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "DELETE /compute/v2.1/servers/7a805bc0-29bf-4ca0-80b2-e2ee71912d51/os-volume_attachments/03ca5ea6-68e8-49cb-9f5c-a96f2261404b" status: 202 len: 0 microversion: 2.1 time: 0.171358 Jun 16 19:09:49.198820 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 540/1062] 10.222.0.70 () {58 vars in 1415 bytes} [Thu Jun 16 19:09:49 2022] DELETE /compute/v2.1/servers/7a805bc0-29bf-4ca0-80b2-e2ee71912d51/os-volume_attachments/03ca5ea6-68e8-49cb-9f5c-a96f2261404b => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:09:49.207316 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-450bc930-e0e9-4f48-9210-ba070057b735 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:09:49.208348 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-450bc930-e0e9-4f48-9210-ba070057b735 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 7a805bc0-29bf-4ca0-80b2-e2ee71912d51] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:09:49.215524 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-450bc930-e0e9-4f48-9210-ba070057b735 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:49.216060 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-450bc930-e0e9-4f48-9210-ba070057b735 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:49.217037 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-450bc930-e0e9-4f48-9210-ba070057b735 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:49.217487 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-450bc930-e0e9-4f48-9210-ba070057b735 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:49.247044 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-450bc930-e0e9-4f48-9210-ba070057b735 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/7a805bc0-29bf-4ca0-80b2-e2ee71912d51/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043616 Jun 16 19:09:49.247736 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 523/1063] 10.222.0.70 () {58 vars in 1301 bytes} [Thu Jun 16 19:09:49 2022] GET /compute/v2.1/servers/7a805bc0-29bf-4ca0-80b2-e2ee71912d51/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:09:50.259911 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-83e47c38-bcf2-4ae6-8a48-44cca4282810 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:09:50.260919 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-83e47c38-bcf2-4ae6-8a48-44cca4282810 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 7a805bc0-29bf-4ca0-80b2-e2ee71912d51] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:09:50.267201 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-83e47c38-bcf2-4ae6-8a48-44cca4282810 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:50.267656 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-83e47c38-bcf2-4ae6-8a48-44cca4282810 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:50.268415 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-83e47c38-bcf2-4ae6-8a48-44cca4282810 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:50.268854 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-83e47c38-bcf2-4ae6-8a48-44cca4282810 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:50.298563 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-83e47c38-bcf2-4ae6-8a48-44cca4282810 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/7a805bc0-29bf-4ca0-80b2-e2ee71912d51/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043538 Jun 16 19:09:50.299131 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 541/1064] 10.222.0.70 () {58 vars in 1301 bytes} [Thu Jun 16 19:09:50 2022] GET /compute/v2.1/servers/7a805bc0-29bf-4ca0-80b2-e2ee71912d51/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 19:09:50.357302 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-6e31851b-b277-4f20-9801-3f9001813113 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:09:50.357790 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-6e31851b-b277-4f20-9801-3f9001813113 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 7a805bc0-29bf-4ca0-80b2-e2ee71912d51] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:09:50.363802 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-6e31851b-b277-4f20-9801-3f9001813113 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:50.364245 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-6e31851b-b277-4f20-9801-3f9001813113 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:50.365125 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-6e31851b-b277-4f20-9801-3f9001813113 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:50.365557 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-6e31851b-b277-4f20-9801-3f9001813113 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:50.390390 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-6e31851b-b277-4f20-9801-3f9001813113 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 7a805bc0-29bf-4ca0-80b2-e2ee71912d51] Going to try to terminate instance {{(pid=117850) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:09:50.466369 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-6e31851b-b277-4f20-9801-3f9001813113 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "DELETE /compute/v2.1/servers/7a805bc0-29bf-4ca0-80b2-e2ee71912d51" status: 204 len: 0 microversion: 2.1 time: 0.112605 Jun 16 19:09:50.466998 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 524/1065] 10.222.0.70 () {58 vars in 1238 bytes} [Thu Jun 16 19:09:50 2022] DELETE /compute/v2.1/servers/7a805bc0-29bf-4ca0-80b2-e2ee71912d51 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:09:50.475273 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-4fe8bac5-c739-4405-8f82-af9e6614b478 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:09:50.475870 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-4fe8bac5-c739-4405-8f82-af9e6614b478 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 7a805bc0-29bf-4ca0-80b2-e2ee71912d51] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:09:50.481818 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-4fe8bac5-c739-4405-8f82-af9e6614b478 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:50.482261 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-4fe8bac5-c739-4405-8f82-af9e6614b478 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:50.483078 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-4fe8bac5-c739-4405-8f82-af9e6614b478 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:50.483518 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-4fe8bac5-c739-4405-8f82-af9e6614b478 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:50.626759 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-4fe8bac5-c739-4405-8f82-af9e6614b478 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f5aba8355c436b94508156bca24ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf39ecb69ea7474d940ad17f8bab4874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:09:50.635585 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-4fe8bac5-c739-4405-8f82-af9e6614b478 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/7a805bc0-29bf-4ca0-80b2-e2ee71912d51" status: 200 len: 1680 microversion: 2.1 time: 0.164217 Jun 16 19:09:50.636150 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 542/1066] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:09:50 2022] GET /compute/v2.1/servers/7a805bc0-29bf-4ca0-80b2-e2ee71912d51 => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:09:51.654281 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-47f53f6e-c329-4d35-81e2-e2979a00e729 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:09:51.655008 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-47f53f6e-c329-4d35-81e2-e2979a00e729 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 7a805bc0-29bf-4ca0-80b2-e2ee71912d51] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:09:51.661260 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-47f53f6e-c329-4d35-81e2-e2979a00e729 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:51.662522 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-47f53f6e-c329-4d35-81e2-e2979a00e729 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:51.663238 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-47f53f6e-c329-4d35-81e2-e2979a00e729 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:51.663671 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-47f53f6e-c329-4d35-81e2-e2979a00e729 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:51.791567 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-47f53f6e-c329-4d35-81e2-e2979a00e729 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f5aba8355c436b94508156bca24ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf39ecb69ea7474d940ad17f8bab4874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:09:51.799037 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-47f53f6e-c329-4d35-81e2-e2979a00e729 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/7a805bc0-29bf-4ca0-80b2-e2ee71912d51" status: 200 len: 1680 microversion: 2.1 time: 0.149373 Jun 16 19:09:51.799594 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 525/1067] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:09:51 2022] GET /compute/v2.1/servers/7a805bc0-29bf-4ca0-80b2-e2ee71912d51 => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:09:52.816597 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-8310f44d-63a4-4ca0-95f6-8d103cdbb4c3 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:09:52.817238 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-8310f44d-63a4-4ca0-95f6-8d103cdbb4c3 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 7a805bc0-29bf-4ca0-80b2-e2ee71912d51] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:09:52.824050 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-8310f44d-63a4-4ca0-95f6-8d103cdbb4c3 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:52.824496 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-8310f44d-63a4-4ca0-95f6-8d103cdbb4c3 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:52.825252 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-8310f44d-63a4-4ca0-95f6-8d103cdbb4c3 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:52.825685 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-8310f44d-63a4-4ca0-95f6-8d103cdbb4c3 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:52.892658 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-8310f44d-63a4-4ca0-95f6-8d103cdbb4c3 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f5aba8355c436b94508156bca24ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf39ecb69ea7474d940ad17f8bab4874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:09:52.903263 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-8310f44d-63a4-4ca0-95f6-8d103cdbb4c3 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/7a805bc0-29bf-4ca0-80b2-e2ee71912d51" status: 200 len: 1613 microversion: 2.1 time: 0.090462 Jun 16 19:09:52.913807 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 543/1068] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:09:52 2022] GET /compute/v2.1/servers/7a805bc0-29bf-4ca0-80b2-e2ee71912d51 => generated 1613 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:09:53.244861 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [req-1267d8d7-55ba-421b-af03-e381b724a782 req-355a5969-d3d5-4375-87da-1a5f3b1355ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a805bc0-29bf-4ca0-80b2-e2ee71912d51", "name": "network-vif-deleted", "tag": "b11cc78f-6579-4a83-bc49-5037445ba296"}]} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:09:53.256244 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-1267d8d7-55ba-421b-af03-e381b724a782 req-355a5969-d3d5-4375-87da-1a5f3b1355ce service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:53.257003 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-1267d8d7-55ba-421b-af03-e381b724a782 req-355a5969-d3d5-4375-87da-1a5f3b1355ce service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:53.272916 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.compute.server_external_events [req-1267d8d7-55ba-421b-af03-e381b724a782 req-355a5969-d3d5-4375-87da-1a5f3b1355ce service nova] Creating event network-vif-deleted:b11cc78f-6579-4a83-bc49-5037445ba296 for instance 7a805bc0-29bf-4ca0-80b2-e2ee71912d51 on hv-cinder-84617 Jun 16 19:09:53.279816 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [req-1267d8d7-55ba-421b-af03-e381b724a782 req-355a5969-d3d5-4375-87da-1a5f3b1355ce service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106764 Jun 16 19:09:53.279816 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 526/1069] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:09:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:09:53.922688 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-48d4aacb-0c36-49aa-9585-dad8404900a9 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:09:53.923315 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-48d4aacb-0c36-49aa-9585-dad8404900a9 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 7a805bc0-29bf-4ca0-80b2-e2ee71912d51] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:09:53.930947 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-48d4aacb-0c36-49aa-9585-dad8404900a9 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:53.931404 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-48d4aacb-0c36-49aa-9585-dad8404900a9 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:53.932179 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-48d4aacb-0c36-49aa-9585-dad8404900a9 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:53.932620 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-48d4aacb-0c36-49aa-9585-dad8404900a9 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:53.947326 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.wsgi [None req-48d4aacb-0c36-49aa-9585-dad8404900a9 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] HTTP exception thrown: Instance 7a805bc0-29bf-4ca0-80b2-e2ee71912d51 could not be found. Jun 16 19:09:53.949085 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-48d4aacb-0c36-49aa-9585-dad8404900a9 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Request method failure captured: Jun 16 19:09:53.949085 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: request: GET /compute/v2.1/servers/7a805bc0-29bf-4ca0-80b2-e2ee71912d51 HTTP/1.1 Jun 16 19:09:53.949085 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Accept: application/json Jun 16 19:09:53.949085 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Accept-Encoding: identity Jun 16 19:09:53.949085 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Connection: close Jun 16 19:09:53.949085 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Content-Length: 0 Jun 16 19:09:53.949085 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Content-Type: application/json Jun 16 19:09:53.949085 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Host: 10.222.0.70 Jun 16 19:09:53.949085 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Openstack-System-Scope: None Jun 16 19:09:53.949085 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: User-Agent: python-urllib3/1.26.9 Jun 16 19:09:53.949085 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Auth-Token: gAAAAABiq397T4ON-zQSBMJgTjz79-0rWbCf9bpfcP8v-Jb0yUpscjKugrXoi0b22yw1HJ_i1bTu9MeeX2PCjDS1AXbAoxSR6e2OSDrQ63ej8My_EvvhndYrxtwl3jqGomk9A-ziExtrOqReYSW9IwopSACLPtaotkV-uvvWqsg4A20E92OPpA0 Jun 16 19:09:53.949085 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Domain-Id: None Jun 16 19:09:53.949085 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Domain-Name: None Jun 16 19:09:53.949085 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Identity-Status: Confirmed Jun 16 19:09:53.949085 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Is-Admin-Project: True Jun 16 19:09:53.949085 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Domain-Id: default Jun 16 19:09:53.949085 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Domain-Name: Default Jun 16 19:09:53.949085 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Id: bf39ecb69ea7474d940ad17f8bab4874 Jun 16 19:09:53.949085 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Name: tempest-AttachVolumeNegativeTest-1452215888 Jun 16 19:09:53.949085 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Role: member,reader Jun 16 19:09:53.949085 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Roles: member,reader Jun 16 19:09:53.951784 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/bf39ecb69ea7474d940ad17f8bab4874"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_bf39ecb69ea7474d940ad17f8bab4874", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/bf39ecb69ea7474d940ad17f8bab4874"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/bf39ecb69ea7474d940ad17f8bab4874"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 16 19:09:53.951784 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant: tempest-AttachVolumeNegativeTest-1452215888 Jun 16 19:09:53.951784 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant-Id: bf39ecb69ea7474d940ad17f8bab4874 Jun 16 19:09:53.951784 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1452215888 Jun 16 19:09:53.951784 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User: tempest-AttachVolumeNegativeTest-1452215888-project Jun 16 19:09:53.951784 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Domain-Id: default Jun 16 19:09:53.951784 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Domain-Name: Default Jun 16 19:09:53.951784 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Id: 55f5aba8355c436b94508156bca24ab3 Jun 16 19:09:53.951784 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Name: tempest-AttachVolumeNegativeTest-1452215888-project Jun 16 19:09:53.951784 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: method: > Jun 16 19:09:53.951784 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: exception: Instance 7a805bc0-29bf-4ca0-80b2-e2ee71912d51 could not be found. Jun 16 19:09:53.951784 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: action_args: {'id': '7a805bc0-29bf-4ca0-80b2-e2ee71912d51'} Jun 16 19:09:53.953737 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:09:53.953737 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:09:53.953737 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:09:53.953737 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:09:53.953737 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:09:53.953737 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:09:53.953737 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:09:53.953737 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:09:53.953737 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:09:53.953737 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:09:53.953737 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a805bc0-29bf-4ca0-80b2-e2ee71912d51 could not be found. Jun 16 19:09:53.953737 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:09:53.953737 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:09:53.953737 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:09:53.953737 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:09:53.953737 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:09:53.953737 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:09:53.953737 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:09:53.953737 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:09:53.953737 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:09:53.955830 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:09:53.955830 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:09:53.955830 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:09:53.955830 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:09:53.955830 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:09:53.955830 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:09:53.955830 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:09:53.955830 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a805bc0-29bf-4ca0-80b2-e2ee71912d51 could not be found. Jun 16 19:09:53.955830 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:09:53.955830 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:09:53.955830 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:09:53.955830 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:09:53.955830 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:09:53.955830 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:09:53.955830 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:09:53.955830 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:09:53.955830 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a805bc0-29bf-4ca0-80b2-e2ee71912d51 could not be found. Jun 16 19:09:53.955830 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:09:53.957316 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-48d4aacb-0c36-49aa-9585-dad8404900a9 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Returning 404 to user: Instance 7a805bc0-29bf-4ca0-80b2-e2ee71912d51 could not be found. {{(pid=117852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:09:53.957316 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-48d4aacb-0c36-49aa-9585-dad8404900a9 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/7a805bc0-29bf-4ca0-80b2-e2ee71912d51" status: 404 len: 111 microversion: 2.1 time: 0.033298 Jun 16 19:09:53.957316 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 544/1070] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:09:53 2022] GET /compute/v2.1/servers/7a805bc0-29bf-4ca0-80b2-e2ee71912d51 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:09:53.960509 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-97fc5b2d-0972-46c8-9088-c0379675eff2 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '.version_select at 0x7f12e5cab550>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:09:53.979400 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-97fc5b2d-0972-46c8-9088-c0379675eff2 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1659385324" status: 202 len: 0 microversion: 2.1 time: 0.023408 Jun 16 19:09:53.980287 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 527/1071] 10.222.0.70 () {58 vars in 1220 bytes} [Thu Jun 16 19:09:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1659385324 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:09:54.914099 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-58b88bde-e111-4c81-ae38-e369b37f4675 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Action: 'create', calling method: .version_select at 0x7f12e5f9e3a0>, body: {"keypair": {"name": "tempest-keypair-1668673222", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFoxCj46H2AnB4E6k6cjv9/WE8EiiUaN9431lzZ8y6HpH+sneTgI722u+YR18g8ax2psb0nxgplZD6bY9TAmSIapYwA1y/J7B5uhIWvrtQCQg8GsQfITENbU6iH1Lj226Q=="}} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:09:54.929824 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.quota [None req-58b88bde-e111-4c81-ae38-e369b37f4675 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Getting quotas for project bf39ecb69ea7474d940ad17f8bab4874. Resources: {'key_pairs'} {{(pid=117852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:09:54.935500 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.quota [None req-58b88bde-e111-4c81-ae38-e369b37f4675 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Getting quotas for user 55f5aba8355c436b94508156bca24ab3 and project bf39ecb69ea7474d940ad17f8bab4874. Resources: {'key_pairs'} {{(pid=117852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:09:54.960768 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-58b88bde-e111-4c81-ae38-e369b37f4675 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051158 Jun 16 19:09:54.961358 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 545/1072] 10.222.0.70 () {60 vars in 1158 bytes} [Thu Jun 16 19:09:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:09:56.300753 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-dc9066f3-e1be-4bb1-9903-11c71c6b0f6e tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-833868490", "imageRef": "1d993e69-7f01-4fe0-ba52-0eae2fa43ddf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "16a4eb33-8dce-42a9-8f45-666580159bfa"}], "security_groups": [{"name": "tempest-securitygroup--603318425"}], "key_name": "tempest-keypair-1668673222", "user_data": "}} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:09:56.414880 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.network.neutron [None req-dc9066f3-e1be-4bb1-9903-11c71c6b0f6e tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] validate_networks() for [('16a4eb33-8dce-42a9-8f45-666580159bfa', None, None, None, None, None)] {{(pid=117850) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:09:56.792747 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-dc9066f3-e1be-4bb1-9903-11c71c6b0f6e tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Flavor limits 0:0:0 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:09:56.793166 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-dc9066f3-e1be-4bb1-9903-11c71c6b0f6e tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Image limits 0:0:0 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:09:56.793633 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-dc9066f3-e1be-4bb1-9903-11c71c6b0f6e tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Flavor pref 0:0:0 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:09:56.794034 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-dc9066f3-e1be-4bb1-9903-11c71c6b0f6e tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Image pref 0:0:0 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:09:56.794440 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-dc9066f3-e1be-4bb1-9903-11c71c6b0f6e tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:09:56.803938 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-dc9066f3-e1be-4bb1-9903-11c71c6b0f6e tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:56.804382 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-dc9066f3-e1be-4bb1-9903-11c71c6b0f6e tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:56.805177 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-dc9066f3-e1be-4bb1-9903-11c71c6b0f6e tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:56.805606 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-dc9066f3-e1be-4bb1-9903-11c71c6b0f6e tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:56.822484 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.quota [None req-dc9066f3-e1be-4bb1-9903-11c71c6b0f6e tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Getting quotas for project bf39ecb69ea7474d940ad17f8bab4874. Resources: {'cores', 'ram', 'instances'} {{(pid=117850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:09:56.826460 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.quota [None req-dc9066f3-e1be-4bb1-9903-11c71c6b0f6e tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Getting quotas for user 55f5aba8355c436b94508156bca24ab3 and project bf39ecb69ea7474d940ad17f8bab4874. Resources: {'cores', 'ram', 'instances'} {{(pid=117850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:09:56.838272 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-dc9066f3-e1be-4bb1-9903-11c71c6b0f6e tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Going to run 1 instances... {{(pid=117850) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:09:56.841474 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-dc9066f3-e1be-4bb1-9903-11c71c6b0f6e tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 084c800e-8268-42d5-8c08-89be0077e1a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1d993e69-7f01-4fe0-ba52-0eae2fa43ddf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:09:56.887670 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-dc9066f3-e1be-4bb1-9903-11c71c6b0f6e tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.591883 Jun 16 19:09:56.888324 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 528/1073] 10.222.0.70 () {60 vars in 1146 bytes} [Thu Jun 16 19:09:56 2022] POST /compute/v2.1/servers => generated 401 bytes in 593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:09:56.899712 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-e968c16d-b6d4-4a6d-a9b3-2c7276500c44 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:09:56.900962 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-e968c16d-b6d4-4a6d-a9b3-2c7276500c44 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 084c800e-8268-42d5-8c08-89be0077e1a3] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:09:56.955796 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-e968c16d-b6d4-4a6d-a9b3-2c7276500c44 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f5aba8355c436b94508156bca24ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf39ecb69ea7474d940ad17f8bab4874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:09:56.963089 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-e968c16d-b6d4-4a6d-a9b3-2c7276500c44 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/084c800e-8268-42d5-8c08-89be0077e1a3" status: 200 len: 1241 microversion: 2.1 time: 0.068512 Jun 16 19:09:56.963665 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 546/1074] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:09:56 2022] GET /compute/v2.1/servers/084c800e-8268-42d5-8c08-89be0077e1a3 => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:09:57.981515 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-de01f20c-428b-445d-9157-8a52f0fbf69d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:09:57.982888 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-de01f20c-428b-445d-9157-8a52f0fbf69d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 084c800e-8268-42d5-8c08-89be0077e1a3] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:09:57.991412 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-de01f20c-428b-445d-9157-8a52f0fbf69d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:57.991842 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-de01f20c-428b-445d-9157-8a52f0fbf69d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:57.992628 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-de01f20c-428b-445d-9157-8a52f0fbf69d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:57.993073 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-de01f20c-428b-445d-9157-8a52f0fbf69d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:58.092961 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-de01f20c-428b-445d-9157-8a52f0fbf69d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f5aba8355c436b94508156bca24ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf39ecb69ea7474d940ad17f8bab4874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:09:58.101629 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-de01f20c-428b-445d-9157-8a52f0fbf69d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/084c800e-8268-42d5-8c08-89be0077e1a3" status: 200 len: 1301 microversion: 2.1 time: 0.124894 Jun 16 19:09:58.102431 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 529/1075] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:09:57 2022] GET /compute/v2.1/servers/084c800e-8268-42d5-8c08-89be0077e1a3 => generated 1301 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:09:59.119799 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-413a46f2-a584-4857-8068-5bd8289684ae tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:09:59.120427 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-413a46f2-a584-4857-8068-5bd8289684ae tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 084c800e-8268-42d5-8c08-89be0077e1a3] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:09:59.127313 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-413a46f2-a584-4857-8068-5bd8289684ae tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:59.128006 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-413a46f2-a584-4857-8068-5bd8289684ae tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:59.128941 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-413a46f2-a584-4857-8068-5bd8289684ae tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:59.129378 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-413a46f2-a584-4857-8068-5bd8289684ae tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:59.154943 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-e3d0de62-1214-4c5f-8c21-3307e315c220 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:09:59.155422 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-e3d0de62-1214-4c5f-8c21-3307e315c220 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: 312b94f9-6264-4dc8-81d3-c5d966852f12] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:09:59.165636 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-e3d0de62-1214-4c5f-8c21-3307e315c220 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:59.166103 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-e3d0de62-1214-4c5f-8c21-3307e315c220 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:59.166886 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-e3d0de62-1214-4c5f-8c21-3307e315c220 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:59.167329 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-e3d0de62-1214-4c5f-8c21-3307e315c220 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:59.204284 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-e3d0de62-1214-4c5f-8c21-3307e315c220 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: 312b94f9-6264-4dc8-81d3-c5d966852f12] Going to try to terminate instance {{(pid=117850) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:09:59.217236 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-413a46f2-a584-4857-8068-5bd8289684ae tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f5aba8355c436b94508156bca24ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf39ecb69ea7474d940ad17f8bab4874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:09:59.225408 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-413a46f2-a584-4857-8068-5bd8289684ae tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/084c800e-8268-42d5-8c08-89be0077e1a3" status: 200 len: 1299 microversion: 2.1 time: 0.110324 Jun 16 19:09:59.235101 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 547/1076] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:09:59 2022] GET /compute/v2.1/servers/084c800e-8268-42d5-8c08-89be0077e1a3 => generated 1299 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:09:59.235101 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [req-0a6fa1fa-4b28-47c5-bd6b-522993c43c02 req-56c3cef8-6aeb-4236-b3c6-d380adc2921e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "312b94f9-6264-4dc8-81d3-c5d966852f12", "tag": "0ff62f9c-41e5-451d-8042-badc5173ffd1"}]} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:09:59.239434 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-0a6fa1fa-4b28-47c5-bd6b-522993c43c02 req-56c3cef8-6aeb-4236-b3c6-d380adc2921e service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:59.240452 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-0a6fa1fa-4b28-47c5-bd6b-522993c43c02 req-56c3cef8-6aeb-4236-b3c6-d380adc2921e service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:59.252868 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.compute.server_external_events [req-0a6fa1fa-4b28-47c5-bd6b-522993c43c02 req-56c3cef8-6aeb-4236-b3c6-d380adc2921e service nova] Creating event network-changed:0ff62f9c-41e5-451d-8042-badc5173ffd1 for instance 312b94f9-6264-4dc8-81d3-c5d966852f12 on hv-cinder-84617 Jun 16 19:09:59.261532 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [req-0a6fa1fa-4b28-47c5-bd6b-522993c43c02 req-56c3cef8-6aeb-4236-b3c6-d380adc2921e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031579 Jun 16 19:09:59.262328 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 548/1077] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:09:59.325754 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-e3d0de62-1214-4c5f-8c21-3307e315c220 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "DELETE /compute/v2.1/servers/312b94f9-6264-4dc8-81d3-c5d966852f12" status: 204 len: 0 microversion: 2.1 time: 0.174344 Jun 16 19:09:59.336513 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-ed7f9231-082c-4726-af61-5655e5d4d7e9 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:09:59.337230 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-ed7f9231-082c-4726-af61-5655e5d4d7e9 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: 312b94f9-6264-4dc8-81d3-c5d966852f12] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:09:59.339719 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 530/1078] 10.222.0.70 () {58 vars in 1238 bytes} [Thu Jun 16 19:09:59 2022] DELETE /compute/v2.1/servers/312b94f9-6264-4dc8-81d3-c5d966852f12 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:09:59.354131 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ed7f9231-082c-4726-af61-5655e5d4d7e9 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:59.354609 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ed7f9231-082c-4726-af61-5655e5d4d7e9 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:59.355372 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ed7f9231-082c-4726-af61-5655e5d4d7e9 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:09:59.355804 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ed7f9231-082c-4726-af61-5655e5d4d7e9 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:09:59.513771 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-ed7f9231-082c-4726-af61-5655e5d4d7e9 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:09:59.536404 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-ed7f9231-082c-4726-af61-5655e5d4d7e9 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/312b94f9-6264-4dc8-81d3-c5d966852f12" status: 200 len: 1578 microversion: 2.1 time: 0.204454 Jun 16 19:09:59.537859 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 549/1079] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:09:59 2022] GET /compute/v2.1/servers/312b94f9-6264-4dc8-81d3-c5d966852f12 => generated 1578 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:10:00.244171 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-b791cddb-c886-4dd9-bc86-98a3e5ebc6ee tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:10:00.244995 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-b791cddb-c886-4dd9-bc86-98a3e5ebc6ee tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 084c800e-8268-42d5-8c08-89be0077e1a3] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:10:00.251587 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b791cddb-c886-4dd9-bc86-98a3e5ebc6ee tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:00.252045 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b791cddb-c886-4dd9-bc86-98a3e5ebc6ee tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:00.252819 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b791cddb-c886-4dd9-bc86-98a3e5ebc6ee tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:00.253261 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b791cddb-c886-4dd9-bc86-98a3e5ebc6ee tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:00.384828 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-b791cddb-c886-4dd9-bc86-98a3e5ebc6ee tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f5aba8355c436b94508156bca24ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf39ecb69ea7474d940ad17f8bab4874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:10:00.392278 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-b791cddb-c886-4dd9-bc86-98a3e5ebc6ee tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/084c800e-8268-42d5-8c08-89be0077e1a3" status: 200 len: 1366 microversion: 2.1 time: 0.153213 Jun 16 19:10:00.392845 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 531/1080] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:10:00 2022] GET /compute/v2.1/servers/084c800e-8268-42d5-8c08-89be0077e1a3 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:10:00.556428 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-9f1cdb64-420a-45c7-acf9-1208c92c29f6 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:10:00.556956 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-9f1cdb64-420a-45c7-acf9-1208c92c29f6 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: 312b94f9-6264-4dc8-81d3-c5d966852f12] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:10:00.563608 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-9f1cdb64-420a-45c7-acf9-1208c92c29f6 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:00.564069 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-9f1cdb64-420a-45c7-acf9-1208c92c29f6 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:00.564836 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-9f1cdb64-420a-45c7-acf9-1208c92c29f6 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:00.565275 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-9f1cdb64-420a-45c7-acf9-1208c92c29f6 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:00.703955 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-9f1cdb64-420a-45c7-acf9-1208c92c29f6 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:10:00.717672 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-9f1cdb64-420a-45c7-acf9-1208c92c29f6 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/312b94f9-6264-4dc8-81d3-c5d966852f12" status: 200 len: 1578 microversion: 2.1 time: 0.165367 Jun 16 19:10:00.721896 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 550/1081] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:10:00 2022] GET /compute/v2.1/servers/312b94f9-6264-4dc8-81d3-c5d966852f12 => generated 1578 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:10:01.411026 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-0ef76203-fe31-4271-94af-e9af4dd71510 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:10:01.411555 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-0ef76203-fe31-4271-94af-e9af4dd71510 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 084c800e-8268-42d5-8c08-89be0077e1a3] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:10:01.418659 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0ef76203-fe31-4271-94af-e9af4dd71510 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:01.419125 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0ef76203-fe31-4271-94af-e9af4dd71510 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:01.419877 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0ef76203-fe31-4271-94af-e9af4dd71510 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:01.420500 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0ef76203-fe31-4271-94af-e9af4dd71510 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:01.646001 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [req-ce5382ae-78d9-4c6b-b6b9-9a620577a596 req-5773a331-4483-4306-a8b9-6fd8cc7719fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "084c800e-8268-42d5-8c08-89be0077e1a3", "tag": "0d77ff6f-2b80-4f10-bf28-ef19e0e28979"}]} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:10:01.655762 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-ce5382ae-78d9-4c6b-b6b9-9a620577a596 req-5773a331-4483-4306-a8b9-6fd8cc7719fa service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:01.662028 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-ce5382ae-78d9-4c6b-b6b9-9a620577a596 req-5773a331-4483-4306-a8b9-6fd8cc7719fa service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:01.675409 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.compute.server_external_events [req-ce5382ae-78d9-4c6b-b6b9-9a620577a596 req-5773a331-4483-4306-a8b9-6fd8cc7719fa service nova] Creating event network-changed:0d77ff6f-2b80-4f10-bf28-ef19e0e28979 for instance 084c800e-8268-42d5-8c08-89be0077e1a3 on hv-cinder-84617 Jun 16 19:10:01.682538 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [req-ce5382ae-78d9-4c6b-b6b9-9a620577a596 req-5773a331-4483-4306-a8b9-6fd8cc7719fa service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040384 Jun 16 19:10:01.683332 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 551/1082] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:10:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:10:01.689075 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [req-8e52ec10-dde3-4c5d-a8b4-89bf8bf8025b req-9e2b369d-4b56-43be-9817-dc1ca0cd6045 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "312b94f9-6264-4dc8-81d3-c5d966852f12", "name": "network-vif-deleted", "tag": "0ff62f9c-41e5-451d-8042-badc5173ffd1"}]} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:10:01.698075 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-8e52ec10-dde3-4c5d-a8b4-89bf8bf8025b req-9e2b369d-4b56-43be-9817-dc1ca0cd6045 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:01.698359 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-8e52ec10-dde3-4c5d-a8b4-89bf8bf8025b req-9e2b369d-4b56-43be-9817-dc1ca0cd6045 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:01.700509 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-0ef76203-fe31-4271-94af-e9af4dd71510 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f5aba8355c436b94508156bca24ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf39ecb69ea7474d940ad17f8bab4874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:10:01.708092 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-0ef76203-fe31-4271-94af-e9af4dd71510 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/084c800e-8268-42d5-8c08-89be0077e1a3" status: 200 len: 1366 microversion: 2.1 time: 0.302161 Jun 16 19:10:01.712676 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.compute.server_external_events [req-8e52ec10-dde3-4c5d-a8b4-89bf8bf8025b req-9e2b369d-4b56-43be-9817-dc1ca0cd6045 service nova] Creating event network-vif-deleted:0ff62f9c-41e5-451d-8042-badc5173ffd1 for instance 312b94f9-6264-4dc8-81d3-c5d966852f12 on hv-cinder-84617 Jun 16 19:10:01.712867 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 532/1083] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:10:01 2022] GET /compute/v2.1/servers/084c800e-8268-42d5-8c08-89be0077e1a3 => generated 1366 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:10:01.715110 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [req-8e52ec10-dde3-4c5d-a8b4-89bf8bf8025b req-9e2b369d-4b56-43be-9817-dc1ca0cd6045 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030188 Jun 16 19:10:01.715696 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 552/1084] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:10:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:10:01.739248 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-c6b53a3a-6470-4559-812e-ce0330037e16 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:10:01.740997 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-c6b53a3a-6470-4559-812e-ce0330037e16 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: 312b94f9-6264-4dc8-81d3-c5d966852f12] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:10:01.747420 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-c6b53a3a-6470-4559-812e-ce0330037e16 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:01.747878 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-c6b53a3a-6470-4559-812e-ce0330037e16 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:01.748659 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-c6b53a3a-6470-4559-812e-ce0330037e16 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:01.749096 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-c6b53a3a-6470-4559-812e-ce0330037e16 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:01.753579 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:10:01.842162 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-c6b53a3a-6470-4559-812e-ce0330037e16 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:10:01.850602 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-c6b53a3a-6470-4559-812e-ce0330037e16 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/312b94f9-6264-4dc8-81d3-c5d966852f12" status: 200 len: 1391 microversion: 2.1 time: 0.115132 Jun 16 19:10:01.851142 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 533/1085] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:10:01 2022] GET /compute/v2.1/servers/312b94f9-6264-4dc8-81d3-c5d966852f12 => generated 1391 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:10:02.727008 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-c9a9e1ce-2fc0-4da5-beb3-f82bbca00a12 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:10:02.727631 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-c9a9e1ce-2fc0-4da5-beb3-f82bbca00a12 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 084c800e-8268-42d5-8c08-89be0077e1a3] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:10:02.733883 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-c9a9e1ce-2fc0-4da5-beb3-f82bbca00a12 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:02.734404 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-c9a9e1ce-2fc0-4da5-beb3-f82bbca00a12 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:02.735271 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-c9a9e1ce-2fc0-4da5-beb3-f82bbca00a12 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:02.735707 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-c9a9e1ce-2fc0-4da5-beb3-f82bbca00a12 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:02.868222 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-8b457bb3-0dad-48af-bbc3-44c999fb748a tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:10:02.868841 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-8b457bb3-0dad-48af-bbc3-44c999fb748a tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: 312b94f9-6264-4dc8-81d3-c5d966852f12] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:10:02.875409 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-8b457bb3-0dad-48af-bbc3-44c999fb748a tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:02.875869 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-8b457bb3-0dad-48af-bbc3-44c999fb748a tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:02.876639 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-8b457bb3-0dad-48af-bbc3-44c999fb748a tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:02.877076 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-8b457bb3-0dad-48af-bbc3-44c999fb748a tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:02.877962 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-c9a9e1ce-2fc0-4da5-beb3-f82bbca00a12 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f5aba8355c436b94508156bca24ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf39ecb69ea7474d940ad17f8bab4874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:10:02.885817 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-c9a9e1ce-2fc0-4da5-beb3-f82bbca00a12 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/084c800e-8268-42d5-8c08-89be0077e1a3" status: 200 len: 1366 microversion: 2.1 time: 0.164255 Jun 16 19:10:02.886480 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 553/1086] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:10:02 2022] GET /compute/v2.1/servers/084c800e-8268-42d5-8c08-89be0077e1a3 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:10:02.893845 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.wsgi [None req-8b457bb3-0dad-48af-bbc3-44c999fb748a tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] HTTP exception thrown: Instance 312b94f9-6264-4dc8-81d3-c5d966852f12 could not be found. Jun 16 19:10:02.895531 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-8b457bb3-0dad-48af-bbc3-44c999fb748a tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Request method failure captured: Jun 16 19:10:02.895531 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: request: GET /compute/v2.1/servers/312b94f9-6264-4dc8-81d3-c5d966852f12 HTTP/1.1 Jun 16 19:10:02.895531 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Accept: application/json Jun 16 19:10:02.895531 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Accept-Encoding: identity Jun 16 19:10:02.895531 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Connection: close Jun 16 19:10:02.895531 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Content-Length: 0 Jun 16 19:10:02.895531 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Content-Type: application/json Jun 16 19:10:02.895531 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Host: 10.222.0.70 Jun 16 19:10:02.895531 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Openstack-System-Scope: None Jun 16 19:10:02.895531 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: User-Agent: python-urllib3/1.26.9 Jun 16 19:10:02.895531 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Auth-Token: gAAAAABiq34F0WyM-_m2GEpkRZwRHfO_AB5SyRKIXbNNWHY2sls-HrF1ksg_iyTwvnWda4lapZqvkXEw9BGAuK62Bq3Ctr5CYGeAEeCIv7lesaNZGekTBTExdJGHeCjMt9EKJOTndixhoLPqoEBLbAQr4Tttu7d3G1qANcrdeLc5Vq94gfak7Xw Jun 16 19:10:02.895531 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Domain-Id: None Jun 16 19:10:02.895531 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Domain-Name: None Jun 16 19:10:02.895531 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Identity-Status: Confirmed Jun 16 19:10:02.895531 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Is-Admin-Project: True Jun 16 19:10:02.895531 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Domain-Id: default Jun 16 19:10:02.895531 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Domain-Name: Default Jun 16 19:10:02.895531 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Id: 0e52189be8d24c9894ef05cc7acf367c Jun 16 19:10:02.895531 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Name: tempest-TestVolumeBootPattern-1500718300 Jun 16 19:10:02.895531 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Role: member,reader Jun 16 19:10:02.895531 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Roles: member,reader Jun 16 19:10:02.898010 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0e52189be8d24c9894ef05cc7acf367c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0e52189be8d24c9894ef05cc7acf367c", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0e52189be8d24c9894ef05cc7acf367c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0e52189be8d24c9894ef05cc7acf367c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 16 19:10:02.898010 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant: tempest-TestVolumeBootPattern-1500718300 Jun 16 19:10:02.898010 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant-Id: 0e52189be8d24c9894ef05cc7acf367c Jun 16 19:10:02.898010 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant-Name: tempest-TestVolumeBootPattern-1500718300 Jun 16 19:10:02.898010 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User: tempest-TestVolumeBootPattern-1500718300-project Jun 16 19:10:02.898010 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Domain-Id: default Jun 16 19:10:02.898010 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Domain-Name: Default Jun 16 19:10:02.898010 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Id: 922a970a740444a2959c6aa1d0921ee7 Jun 16 19:10:02.898010 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Name: tempest-TestVolumeBootPattern-1500718300-project Jun 16 19:10:02.898010 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: method: > Jun 16 19:10:02.898010 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: exception: Instance 312b94f9-6264-4dc8-81d3-c5d966852f12 could not be found. Jun 16 19:10:02.898010 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: action_args: {'id': '312b94f9-6264-4dc8-81d3-c5d966852f12'} Jun 16 19:10:02.899109 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:10:02.899109 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:10:02.899109 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:10:02.899109 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:10:02.899109 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:10:02.899109 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:10:02.899109 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:10:02.899109 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:10:02.899109 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:10:02.899109 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:10:02.899109 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 312b94f9-6264-4dc8-81d3-c5d966852f12 could not be found. Jun 16 19:10:02.899109 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:10:02.899109 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:10:02.899109 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:10:02.899109 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:10:02.899109 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:10:02.899109 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:10:02.899109 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:10:02.899109 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:10:02.899109 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:10:02.900707 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:10:02.900707 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:10:02.900707 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:10:02.900707 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:10:02.900707 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:10:02.900707 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:10:02.900707 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:10:02.900707 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 312b94f9-6264-4dc8-81d3-c5d966852f12 could not be found. Jun 16 19:10:02.900707 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:10:02.900707 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:10:02.900707 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:10:02.900707 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:10:02.900707 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:10:02.900707 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:10:02.900707 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:10:02.900707 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:10:02.900707 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 312b94f9-6264-4dc8-81d3-c5d966852f12 could not be found. Jun 16 19:10:02.900707 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:10:02.902397 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-8b457bb3-0dad-48af-bbc3-44c999fb748a tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Returning 404 to user: Instance 312b94f9-6264-4dc8-81d3-c5d966852f12 could not be found. {{(pid=117850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:10:02.902397 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-8b457bb3-0dad-48af-bbc3-44c999fb748a tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/312b94f9-6264-4dc8-81d3-c5d966852f12" status: 404 len: 111 microversion: 2.1 time: 0.034425 Jun 16 19:10:02.902397 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 534/1087] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:10:02 2022] GET /compute/v2.1/servers/312b94f9-6264-4dc8-81d3-c5d966852f12 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 19:10:03.903296 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-629ac7cf-69a7-47c1-9d10-388cf3735ff6 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:10:03.903928 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-629ac7cf-69a7-47c1-9d10-388cf3735ff6 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 084c800e-8268-42d5-8c08-89be0077e1a3] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:10:03.910357 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-629ac7cf-69a7-47c1-9d10-388cf3735ff6 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:03.910905 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-629ac7cf-69a7-47c1-9d10-388cf3735ff6 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:03.912237 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-629ac7cf-69a7-47c1-9d10-388cf3735ff6 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:03.912676 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-629ac7cf-69a7-47c1-9d10-388cf3735ff6 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:04.046106 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-629ac7cf-69a7-47c1-9d10-388cf3735ff6 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f5aba8355c436b94508156bca24ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf39ecb69ea7474d940ad17f8bab4874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:10:04.054364 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-629ac7cf-69a7-47c1-9d10-388cf3735ff6 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/084c800e-8268-42d5-8c08-89be0077e1a3" status: 200 len: 1366 microversion: 2.1 time: 0.155326 Jun 16 19:10:04.054962 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 554/1088] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:10:03 2022] GET /compute/v2.1/servers/084c800e-8268-42d5-8c08-89be0077e1a3 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:10:05.070702 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-f5a9be35-bb23-4f13-b112-cf326bf72f7b tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:10:05.071325 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-f5a9be35-bb23-4f13-b112-cf326bf72f7b tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 084c800e-8268-42d5-8c08-89be0077e1a3] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:10:05.077765 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-f5a9be35-bb23-4f13-b112-cf326bf72f7b tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:05.078216 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-f5a9be35-bb23-4f13-b112-cf326bf72f7b tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:05.079009 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-f5a9be35-bb23-4f13-b112-cf326bf72f7b tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:05.079446 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-f5a9be35-bb23-4f13-b112-cf326bf72f7b tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:05.214535 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-f5a9be35-bb23-4f13-b112-cf326bf72f7b tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f5aba8355c436b94508156bca24ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf39ecb69ea7474d940ad17f8bab4874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:10:05.222104 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-f5a9be35-bb23-4f13-b112-cf326bf72f7b tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/084c800e-8268-42d5-8c08-89be0077e1a3" status: 200 len: 1366 microversion: 2.1 time: 0.155477 Jun 16 19:10:05.222690 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 535/1089] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:10:05 2022] GET /compute/v2.1/servers/084c800e-8268-42d5-8c08-89be0077e1a3 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:10:05.979498 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-11f7a4bd-2e64-4b4b-b2d4-30bff2929151 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:10:05.980992 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [req-4f75cdaf-bf7b-47d8-893d-98cedecec784 req-7271294a-dced-4885-abf9-e68c55eef73f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0052d136-dd29-43bf-a063-487cc87fd84d", "tag": "9f4f9c02-22f2-4c20-a150-09014370754f"}]} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:10:05.981348 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-11f7a4bd-2e64-4b4b-b2d4-30bff2929151 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: 0052d136-dd29-43bf-a063-487cc87fd84d] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:10:05.988408 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-11f7a4bd-2e64-4b4b-b2d4-30bff2929151 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:05.988947 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-11f7a4bd-2e64-4b4b-b2d4-30bff2929151 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:05.989134 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-4f75cdaf-bf7b-47d8-893d-98cedecec784 req-7271294a-dced-4885-abf9-e68c55eef73f service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:05.989867 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-4f75cdaf-bf7b-47d8-893d-98cedecec784 req-7271294a-dced-4885-abf9-e68c55eef73f service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:05.990601 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-11f7a4bd-2e64-4b4b-b2d4-30bff2929151 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:05.991289 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-11f7a4bd-2e64-4b4b-b2d4-30bff2929151 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:06.001347 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.compute.server_external_events [req-4f75cdaf-bf7b-47d8-893d-98cedecec784 req-7271294a-dced-4885-abf9-e68c55eef73f service nova] Creating event network-changed:9f4f9c02-22f2-4c20-a150-09014370754f for instance 0052d136-dd29-43bf-a063-487cc87fd84d on hv-cinder-84617 Jun 16 19:10:06.007196 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [req-4f75cdaf-bf7b-47d8-893d-98cedecec784 req-7271294a-dced-4885-abf9-e68c55eef73f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029769 Jun 16 19:10:06.008114 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 536/1090] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:10:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 19:10:06.019865 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-11f7a4bd-2e64-4b4b-b2d4-30bff2929151 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: 0052d136-dd29-43bf-a063-487cc87fd84d] Going to try to terminate instance {{(pid=117852) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:10:06.111816 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-11f7a4bd-2e64-4b4b-b2d4-30bff2929151 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "DELETE /compute/v2.1/servers/0052d136-dd29-43bf-a063-487cc87fd84d" status: 204 len: 0 microversion: 2.1 time: 0.137324 Jun 16 19:10:06.112725 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 555/1091] 10.222.0.70 () {58 vars in 1238 bytes} [Thu Jun 16 19:10:05 2022] DELETE /compute/v2.1/servers/0052d136-dd29-43bf-a063-487cc87fd84d => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:10:06.122832 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-9e0d3d7b-0e4e-4f0e-ba06-2daf0a37da2a tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:10:06.126260 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-9e0d3d7b-0e4e-4f0e-ba06-2daf0a37da2a tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: 0052d136-dd29-43bf-a063-487cc87fd84d] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:10:06.134391 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-9e0d3d7b-0e4e-4f0e-ba06-2daf0a37da2a tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:06.134973 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-9e0d3d7b-0e4e-4f0e-ba06-2daf0a37da2a tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:06.135835 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-9e0d3d7b-0e4e-4f0e-ba06-2daf0a37da2a tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:06.136357 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-9e0d3d7b-0e4e-4f0e-ba06-2daf0a37da2a tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:06.246834 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-9fc0d9f5-4197-4942-9d15-eefa04d281e3 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:10:06.247797 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-9fc0d9f5-4197-4942-9d15-eefa04d281e3 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 084c800e-8268-42d5-8c08-89be0077e1a3] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:10:06.254018 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-9fc0d9f5-4197-4942-9d15-eefa04d281e3 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:06.254616 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-9fc0d9f5-4197-4942-9d15-eefa04d281e3 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:06.256792 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-9fc0d9f5-4197-4942-9d15-eefa04d281e3 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:06.257308 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-9fc0d9f5-4197-4942-9d15-eefa04d281e3 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:06.262553 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:10:06.296725 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-9e0d3d7b-0e4e-4f0e-ba06-2daf0a37da2a tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:10:06.305790 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-9e0d3d7b-0e4e-4f0e-ba06-2daf0a37da2a tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/0052d136-dd29-43bf-a063-487cc87fd84d" status: 200 len: 1576 microversion: 2.1 time: 0.188594 Jun 16 19:10:06.315597 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 537/1092] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:10:06 2022] GET /compute/v2.1/servers/0052d136-dd29-43bf-a063-487cc87fd84d => generated 1576 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:10:06.400819 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-9fc0d9f5-4197-4942-9d15-eefa04d281e3 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f5aba8355c436b94508156bca24ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf39ecb69ea7474d940ad17f8bab4874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:10:06.408477 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-9fc0d9f5-4197-4942-9d15-eefa04d281e3 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/084c800e-8268-42d5-8c08-89be0077e1a3" status: 200 len: 1366 microversion: 2.1 time: 0.165981 Jun 16 19:10:06.409047 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 556/1093] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:10:06 2022] GET /compute/v2.1/servers/084c800e-8268-42d5-8c08-89be0077e1a3 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:10:07.323952 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-32105233-4195-4164-9324-1ca46b50d963 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:10:07.324584 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-32105233-4195-4164-9324-1ca46b50d963 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: 0052d136-dd29-43bf-a063-487cc87fd84d] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:10:07.326536 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_cell0:SELECT=2 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:10:07.327263 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_cell0:SELECT=6 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:10:07.335058 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-32105233-4195-4164-9324-1ca46b50d963 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:07.335497 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-32105233-4195-4164-9324-1ca46b50d963 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:07.336293 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-32105233-4195-4164-9324-1ca46b50d963 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:07.336743 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-32105233-4195-4164-9324-1ca46b50d963 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:07.425774 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-8932a30b-5ca2-4693-897e-bc711f6ec7f4 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:10:07.426537 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-8932a30b-5ca2-4693-897e-bc711f6ec7f4 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 084c800e-8268-42d5-8c08-89be0077e1a3] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:10:07.429488 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_cell0:SELECT=6 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:10:07.435611 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-8932a30b-5ca2-4693-897e-bc711f6ec7f4 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:07.436066 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-8932a30b-5ca2-4693-897e-bc711f6ec7f4 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:07.436869 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-8932a30b-5ca2-4693-897e-bc711f6ec7f4 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:07.437303 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-8932a30b-5ca2-4693-897e-bc711f6ec7f4 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:07.476773 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-32105233-4195-4164-9324-1ca46b50d963 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:10:07.484394 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-32105233-4195-4164-9324-1ca46b50d963 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/0052d136-dd29-43bf-a063-487cc87fd84d" status: 200 len: 1576 microversion: 2.1 time: 0.164905 Jun 16 19:10:07.485666 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 538/1094] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:10:07 2022] GET /compute/v2.1/servers/0052d136-dd29-43bf-a063-487cc87fd84d => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:10:07.577491 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-8932a30b-5ca2-4693-897e-bc711f6ec7f4 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f5aba8355c436b94508156bca24ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf39ecb69ea7474d940ad17f8bab4874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:10:07.585549 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-8932a30b-5ca2-4693-897e-bc711f6ec7f4 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/084c800e-8268-42d5-8c08-89be0077e1a3" status: 200 len: 1366 microversion: 2.1 time: 0.164023 Jun 16 19:10:07.586106 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 557/1095] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:10:07 2022] GET /compute/v2.1/servers/084c800e-8268-42d5-8c08-89be0077e1a3 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:10:08.369247 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [req-73599bbb-bf31-4b5d-bb3e-a0f9432040a3 req-d9bb9aac-86fe-4e78-9fc6-f2c8d2f591d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0052d136-dd29-43bf-a063-487cc87fd84d", "name": "network-vif-deleted", "tag": "9f4f9c02-22f2-4c20-a150-09014370754f"}]} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:10:08.381100 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-73599bbb-bf31-4b5d-bb3e-a0f9432040a3 req-d9bb9aac-86fe-4e78-9fc6-f2c8d2f591d7 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:08.381672 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-73599bbb-bf31-4b5d-bb3e-a0f9432040a3 req-d9bb9aac-86fe-4e78-9fc6-f2c8d2f591d7 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:08.392865 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.compute.server_external_events [req-73599bbb-bf31-4b5d-bb3e-a0f9432040a3 req-d9bb9aac-86fe-4e78-9fc6-f2c8d2f591d7 service nova] Creating event network-vif-deleted:9f4f9c02-22f2-4c20-a150-09014370754f for instance 0052d136-dd29-43bf-a063-487cc87fd84d on hv-cinder-84617 Jun 16 19:10:08.398449 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [req-73599bbb-bf31-4b5d-bb3e-a0f9432040a3 req-d9bb9aac-86fe-4e78-9fc6-f2c8d2f591d7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033657 Jun 16 19:10:08.399152 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 539/1096] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:10:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:10:08.502557 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-694bd062-c5f4-4729-adbc-ef381156e96c tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:10:08.503212 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-694bd062-c5f4-4729-adbc-ef381156e96c tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: 0052d136-dd29-43bf-a063-487cc87fd84d] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:10:08.510145 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-694bd062-c5f4-4729-adbc-ef381156e96c tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:08.510611 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-694bd062-c5f4-4729-adbc-ef381156e96c tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:08.511556 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-694bd062-c5f4-4729-adbc-ef381156e96c tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:08.511998 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-694bd062-c5f4-4729-adbc-ef381156e96c tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:08.575289 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-694bd062-c5f4-4729-adbc-ef381156e96c tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922a970a740444a2959c6aa1d0921ee7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e52189be8d24c9894ef05cc7acf367c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:10:08.583000 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-694bd062-c5f4-4729-adbc-ef381156e96c tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/0052d136-dd29-43bf-a063-487cc87fd84d" status: 200 len: 1223 microversion: 2.1 time: 0.084264 Jun 16 19:10:08.583593 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 558/1097] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:10:08 2022] GET /compute/v2.1/servers/0052d136-dd29-43bf-a063-487cc87fd84d => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:10:08.603856 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-622084fa-351b-4d87-a238-b47f4c52e000 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:10:08.604713 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-622084fa-351b-4d87-a238-b47f4c52e000 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 084c800e-8268-42d5-8c08-89be0077e1a3] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:10:08.611108 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-622084fa-351b-4d87-a238-b47f4c52e000 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:08.611553 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-622084fa-351b-4d87-a238-b47f4c52e000 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:08.612309 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-622084fa-351b-4d87-a238-b47f4c52e000 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:08.612736 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-622084fa-351b-4d87-a238-b47f4c52e000 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:08.785660 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-622084fa-351b-4d87-a238-b47f4c52e000 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f5aba8355c436b94508156bca24ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf39ecb69ea7474d940ad17f8bab4874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:10:08.794308 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-622084fa-351b-4d87-a238-b47f4c52e000 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/084c800e-8268-42d5-8c08-89be0077e1a3" status: 200 len: 1366 microversion: 2.1 time: 0.195129 Jun 16 19:10:08.795247 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 540/1098] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:10:08 2022] GET /compute/v2.1/servers/084c800e-8268-42d5-8c08-89be0077e1a3 => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:10:09.022876 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [req-bb86d97d-f8ce-4e79-95ae-96926d1e1090 req-85325373-7d87-490d-a548-b6013f60601f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "084c800e-8268-42d5-8c08-89be0077e1a3", "name": "network-vif-plugged", "status": "completed", "tag": "0d77ff6f-2b80-4f10-bf28-ef19e0e28979"}]} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:10:09.035269 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-bb86d97d-f8ce-4e79-95ae-96926d1e1090 req-85325373-7d87-490d-a548-b6013f60601f service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:09.035720 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-bb86d97d-f8ce-4e79-95ae-96926d1e1090 req-85325373-7d87-490d-a548-b6013f60601f service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:09.048250 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.compute.server_external_events [req-bb86d97d-f8ce-4e79-95ae-96926d1e1090 req-85325373-7d87-490d-a548-b6013f60601f service nova] Creating event network-vif-plugged:0d77ff6f-2b80-4f10-bf28-ef19e0e28979 for instance 084c800e-8268-42d5-8c08-89be0077e1a3 on hv-cinder-84617 Jun 16 19:10:09.053937 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [req-bb86d97d-f8ce-4e79-95ae-96926d1e1090 req-85325373-7d87-490d-a548-b6013f60601f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099423 Jun 16 19:10:09.054814 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 559/1099] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:10:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:10:09.601516 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-6ff7e275-e98d-45e6-af6d-1f8ae01c49e8 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:10:09.602073 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-6ff7e275-e98d-45e6-af6d-1f8ae01c49e8 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: 0052d136-dd29-43bf-a063-487cc87fd84d] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:10:09.608708 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-6ff7e275-e98d-45e6-af6d-1f8ae01c49e8 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:09.609151 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-6ff7e275-e98d-45e6-af6d-1f8ae01c49e8 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:09.609910 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-6ff7e275-e98d-45e6-af6d-1f8ae01c49e8 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:09.610343 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-6ff7e275-e98d-45e6-af6d-1f8ae01c49e8 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:09.624281 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.wsgi [None req-6ff7e275-e98d-45e6-af6d-1f8ae01c49e8 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] HTTP exception thrown: Instance 0052d136-dd29-43bf-a063-487cc87fd84d could not be found. Jun 16 19:10:09.625923 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-6ff7e275-e98d-45e6-af6d-1f8ae01c49e8 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Request method failure captured: Jun 16 19:10:09.625923 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: request: GET /compute/v2.1/servers/0052d136-dd29-43bf-a063-487cc87fd84d HTTP/1.1 Jun 16 19:10:09.625923 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Accept: application/json Jun 16 19:10:09.625923 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Accept-Encoding: identity Jun 16 19:10:09.625923 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Connection: close Jun 16 19:10:09.625923 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Content-Length: 0 Jun 16 19:10:09.625923 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Content-Type: application/json Jun 16 19:10:09.625923 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Host: 10.222.0.70 Jun 16 19:10:09.625923 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Openstack-System-Scope: None Jun 16 19:10:09.625923 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: User-Agent: python-urllib3/1.26.9 Jun 16 19:10:09.625923 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Auth-Token: gAAAAABiq34F0WyM-_m2GEpkRZwRHfO_AB5SyRKIXbNNWHY2sls-HrF1ksg_iyTwvnWda4lapZqvkXEw9BGAuK62Bq3Ctr5CYGeAEeCIv7lesaNZGekTBTExdJGHeCjMt9EKJOTndixhoLPqoEBLbAQr4Tttu7d3G1qANcrdeLc5Vq94gfak7Xw Jun 16 19:10:09.625923 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Domain-Id: None Jun 16 19:10:09.625923 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Domain-Name: None Jun 16 19:10:09.625923 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Identity-Status: Confirmed Jun 16 19:10:09.625923 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Is-Admin-Project: True Jun 16 19:10:09.625923 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Domain-Id: default Jun 16 19:10:09.625923 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Domain-Name: Default Jun 16 19:10:09.625923 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Id: 0e52189be8d24c9894ef05cc7acf367c Jun 16 19:10:09.625923 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Name: tempest-TestVolumeBootPattern-1500718300 Jun 16 19:10:09.625923 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Role: member,reader Jun 16 19:10:09.625923 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Roles: member,reader Jun 16 19:10:09.627588 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0e52189be8d24c9894ef05cc7acf367c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0e52189be8d24c9894ef05cc7acf367c", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0e52189be8d24c9894ef05cc7acf367c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0e52189be8d24c9894ef05cc7acf367c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 16 19:10:09.627588 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant: tempest-TestVolumeBootPattern-1500718300 Jun 16 19:10:09.627588 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant-Id: 0e52189be8d24c9894ef05cc7acf367c Jun 16 19:10:09.627588 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant-Name: tempest-TestVolumeBootPattern-1500718300 Jun 16 19:10:09.627588 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User: tempest-TestVolumeBootPattern-1500718300-project Jun 16 19:10:09.627588 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Domain-Id: default Jun 16 19:10:09.627588 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Domain-Name: Default Jun 16 19:10:09.627588 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Id: 922a970a740444a2959c6aa1d0921ee7 Jun 16 19:10:09.627588 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Name: tempest-TestVolumeBootPattern-1500718300-project Jun 16 19:10:09.627588 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: method: > Jun 16 19:10:09.627588 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: exception: Instance 0052d136-dd29-43bf-a063-487cc87fd84d could not be found. Jun 16 19:10:09.627588 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: action_args: {'id': '0052d136-dd29-43bf-a063-487cc87fd84d'} Jun 16 19:10:09.628748 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:10:09.628748 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:10:09.628748 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:10:09.628748 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:10:09.628748 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:10:09.628748 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:10:09.628748 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:10:09.628748 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:10:09.628748 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:10:09.628748 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:10:09.628748 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0052d136-dd29-43bf-a063-487cc87fd84d could not be found. Jun 16 19:10:09.628748 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:10:09.628748 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:10:09.628748 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:10:09.628748 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:10:09.628748 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:10:09.628748 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:10:09.628748 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:10:09.628748 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:10:09.628748 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:10:09.631059 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:10:09.631059 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:10:09.631059 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:10:09.631059 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:10:09.631059 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:10:09.631059 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:10:09.631059 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:10:09.631059 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0052d136-dd29-43bf-a063-487cc87fd84d could not be found. Jun 16 19:10:09.631059 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:10:09.631059 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:10:09.631059 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:10:09.631059 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:10:09.631059 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:10:09.631059 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:10:09.631059 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:10:09.631059 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:10:09.631059 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0052d136-dd29-43bf-a063-487cc87fd84d could not be found. Jun 16 19:10:09.631059 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:10:09.632459 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-6ff7e275-e98d-45e6-af6d-1f8ae01c49e8 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Returning 404 to user: Instance 0052d136-dd29-43bf-a063-487cc87fd84d could not be found. {{(pid=117850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:10:09.632459 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-6ff7e275-e98d-45e6-af6d-1f8ae01c49e8 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/0052d136-dd29-43bf-a063-487cc87fd84d" status: 404 len: 111 microversion: 2.1 time: 0.030789 Jun 16 19:10:09.632459 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 541/1100] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:10:09 2022] GET /compute/v2.1/servers/0052d136-dd29-43bf-a063-487cc87fd84d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:10:09.812677 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-fd003ecc-c668-4c01-8b5f-a0324aa1584d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:10:09.813573 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-fd003ecc-c668-4c01-8b5f-a0324aa1584d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 084c800e-8268-42d5-8c08-89be0077e1a3] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:10:09.820768 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-fd003ecc-c668-4c01-8b5f-a0324aa1584d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:09.821222 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-fd003ecc-c668-4c01-8b5f-a0324aa1584d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:09.822016 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-fd003ecc-c668-4c01-8b5f-a0324aa1584d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:09.822454 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-fd003ecc-c668-4c01-8b5f-a0324aa1584d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:09.954372 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-fd003ecc-c668-4c01-8b5f-a0324aa1584d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f5aba8355c436b94508156bca24ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf39ecb69ea7474d940ad17f8bab4874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:10:09.963420 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-fd003ecc-c668-4c01-8b5f-a0324aa1584d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/084c800e-8268-42d5-8c08-89be0077e1a3" status: 200 len: 1366 microversion: 2.1 time: 0.155416 Jun 16 19:10:09.963996 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 560/1101] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:10:09 2022] GET /compute/v2.1/servers/084c800e-8268-42d5-8c08-89be0077e1a3 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:10:10.091108 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-b073ea70-5972-40b5-874d-92bb6c139e88 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:10:10.091613 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-b073ea70-5972-40b5-874d-92bb6c139e88 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: b99da3e1-cab4-41a0-a1e4-6a29efeb77f2] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:10:10.097645 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b073ea70-5972-40b5-874d-92bb6c139e88 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:10.098101 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b073ea70-5972-40b5-874d-92bb6c139e88 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:10.099396 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b073ea70-5972-40b5-874d-92bb6c139e88 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:10.099846 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b073ea70-5972-40b5-874d-92bb6c139e88 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:10.113135 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.wsgi [None req-b073ea70-5972-40b5-874d-92bb6c139e88 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] HTTP exception thrown: Instance b99da3e1-cab4-41a0-a1e4-6a29efeb77f2 could not be found. Jun 16 19:10:10.115448 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-b073ea70-5972-40b5-874d-92bb6c139e88 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Request method failure captured: Jun 16 19:10:10.115448 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: request: DELETE /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2 HTTP/1.1 Jun 16 19:10:10.115448 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Accept: application/json Jun 16 19:10:10.115448 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Accept-Encoding: identity Jun 16 19:10:10.115448 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Connection: close Jun 16 19:10:10.115448 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Content-Length: 0 Jun 16 19:10:10.115448 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Content-Type: application/json Jun 16 19:10:10.115448 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Host: 10.222.0.70 Jun 16 19:10:10.115448 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Openstack-System-Scope: None Jun 16 19:10:10.115448 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: User-Agent: python-urllib3/1.26.9 Jun 16 19:10:10.115448 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Auth-Token: gAAAAABiq34F0WyM-_m2GEpkRZwRHfO_AB5SyRKIXbNNWHY2sls-HrF1ksg_iyTwvnWda4lapZqvkXEw9BGAuK62Bq3Ctr5CYGeAEeCIv7lesaNZGekTBTExdJGHeCjMt9EKJOTndixhoLPqoEBLbAQr4Tttu7d3G1qANcrdeLc5Vq94gfak7Xw Jun 16 19:10:10.115448 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Domain-Id: None Jun 16 19:10:10.115448 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Domain-Name: None Jun 16 19:10:10.115448 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Identity-Status: Confirmed Jun 16 19:10:10.115448 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Is-Admin-Project: True Jun 16 19:10:10.115448 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Domain-Id: default Jun 16 19:10:10.115448 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Domain-Name: Default Jun 16 19:10:10.115448 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Id: 0e52189be8d24c9894ef05cc7acf367c Jun 16 19:10:10.115448 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Name: tempest-TestVolumeBootPattern-1500718300 Jun 16 19:10:10.115448 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Role: member,reader Jun 16 19:10:10.115448 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Roles: member,reader Jun 16 19:10:10.117180 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0e52189be8d24c9894ef05cc7acf367c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0e52189be8d24c9894ef05cc7acf367c", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0e52189be8d24c9894ef05cc7acf367c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0e52189be8d24c9894ef05cc7acf367c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 16 19:10:10.117180 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant: tempest-TestVolumeBootPattern-1500718300 Jun 16 19:10:10.117180 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant-Id: 0e52189be8d24c9894ef05cc7acf367c Jun 16 19:10:10.117180 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant-Name: tempest-TestVolumeBootPattern-1500718300 Jun 16 19:10:10.117180 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User: tempest-TestVolumeBootPattern-1500718300-project Jun 16 19:10:10.117180 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Domain-Id: default Jun 16 19:10:10.117180 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Domain-Name: Default Jun 16 19:10:10.117180 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Id: 922a970a740444a2959c6aa1d0921ee7 Jun 16 19:10:10.117180 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Name: tempest-TestVolumeBootPattern-1500718300-project Jun 16 19:10:10.117180 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: method: > Jun 16 19:10:10.117180 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: exception: Instance b99da3e1-cab4-41a0-a1e4-6a29efeb77f2 could not be found. Jun 16 19:10:10.117180 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: action_args: {'id': 'b99da3e1-cab4-41a0-a1e4-6a29efeb77f2'} Jun 16 19:10:10.118043 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:10:10.118043 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:10:10.118043 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:10:10.118043 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:10:10.118043 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:10:10.118043 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:10:10.118043 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:10:10.118043 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:10:10.118043 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:10:10.118043 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:10:10.118043 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b99da3e1-cab4-41a0-a1e4-6a29efeb77f2 could not be found. Jun 16 19:10:10.118043 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:10:10.118043 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:10:10.118043 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:10:10.118043 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:10:10.118043 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:10:10.118043 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:10:10.118043 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:10:10.118043 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:10:10.118043 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:10:10.119604 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:10:10.119604 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 19:10:10.119604 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 19:10:10.119604 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 19:10:10.119604 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 19:10:10.119604 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:10:10.119604 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:10:10.119604 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:10:10.119604 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:10:10.119604 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b99da3e1-cab4-41a0-a1e4-6a29efeb77f2 could not be found. Jun 16 19:10:10.119604 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:10:10.119604 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:10:10.119604 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:10:10.119604 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:10:10.119604 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:10:10.119604 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:10:10.119604 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:10:10.119604 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:10:10.119604 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b99da3e1-cab4-41a0-a1e4-6a29efeb77f2 could not be found. Jun 16 19:10:10.119604 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:10:10.121213 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-b073ea70-5972-40b5-874d-92bb6c139e88 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Returning 404 to user: Instance b99da3e1-cab4-41a0-a1e4-6a29efeb77f2 could not be found. {{(pid=117850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:10:10.121213 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-b073ea70-5972-40b5-874d-92bb6c139e88 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "DELETE /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2" status: 404 len: 111 microversion: 2.1 time: 0.029892 Jun 16 19:10:10.121213 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 542/1102] 10.222.0.70 () {58 vars in 1238 bytes} [Thu Jun 16 19:10:10 2022] DELETE /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:10:10.125724 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-fba32be7-d025-44c8-9088-fb29880e91f6 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:10:10.126335 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-fba32be7-d025-44c8-9088-fb29880e91f6 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] [instance: b99da3e1-cab4-41a0-a1e4-6a29efeb77f2] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:10:10.132305 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-fba32be7-d025-44c8-9088-fb29880e91f6 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:10.132747 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-fba32be7-d025-44c8-9088-fb29880e91f6 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:10.133495 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-fba32be7-d025-44c8-9088-fb29880e91f6 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:10.133930 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-fba32be7-d025-44c8-9088-fb29880e91f6 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:10.147257 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.wsgi [None req-fba32be7-d025-44c8-9088-fb29880e91f6 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] HTTP exception thrown: Instance b99da3e1-cab4-41a0-a1e4-6a29efeb77f2 could not be found. Jun 16 19:10:10.148918 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-fba32be7-d025-44c8-9088-fb29880e91f6 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Request method failure captured: Jun 16 19:10:10.148918 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: request: GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2 HTTP/1.1 Jun 16 19:10:10.148918 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Accept: application/json Jun 16 19:10:10.148918 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Accept-Encoding: identity Jun 16 19:10:10.148918 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Connection: close Jun 16 19:10:10.148918 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Content-Length: 0 Jun 16 19:10:10.148918 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Content-Type: application/json Jun 16 19:10:10.148918 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Host: 10.222.0.70 Jun 16 19:10:10.148918 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Openstack-System-Scope: None Jun 16 19:10:10.148918 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: User-Agent: python-urllib3/1.26.9 Jun 16 19:10:10.148918 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Auth-Token: gAAAAABiq34F0WyM-_m2GEpkRZwRHfO_AB5SyRKIXbNNWHY2sls-HrF1ksg_iyTwvnWda4lapZqvkXEw9BGAuK62Bq3Ctr5CYGeAEeCIv7lesaNZGekTBTExdJGHeCjMt9EKJOTndixhoLPqoEBLbAQr4Tttu7d3G1qANcrdeLc5Vq94gfak7Xw Jun 16 19:10:10.148918 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Domain-Id: None Jun 16 19:10:10.148918 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Domain-Name: None Jun 16 19:10:10.148918 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Identity-Status: Confirmed Jun 16 19:10:10.148918 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Is-Admin-Project: True Jun 16 19:10:10.148918 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Domain-Id: default Jun 16 19:10:10.148918 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Domain-Name: Default Jun 16 19:10:10.148918 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Id: 0e52189be8d24c9894ef05cc7acf367c Jun 16 19:10:10.148918 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Name: tempest-TestVolumeBootPattern-1500718300 Jun 16 19:10:10.148918 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Role: member,reader Jun 16 19:10:10.148918 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Roles: member,reader Jun 16 19:10:10.150557 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0e52189be8d24c9894ef05cc7acf367c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0e52189be8d24c9894ef05cc7acf367c", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0e52189be8d24c9894ef05cc7acf367c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0e52189be8d24c9894ef05cc7acf367c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 16 19:10:10.150557 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant: tempest-TestVolumeBootPattern-1500718300 Jun 16 19:10:10.150557 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant-Id: 0e52189be8d24c9894ef05cc7acf367c Jun 16 19:10:10.150557 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant-Name: tempest-TestVolumeBootPattern-1500718300 Jun 16 19:10:10.150557 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User: tempest-TestVolumeBootPattern-1500718300-project Jun 16 19:10:10.150557 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Domain-Id: default Jun 16 19:10:10.150557 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Domain-Name: Default Jun 16 19:10:10.150557 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Id: 922a970a740444a2959c6aa1d0921ee7 Jun 16 19:10:10.150557 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Name: tempest-TestVolumeBootPattern-1500718300-project Jun 16 19:10:10.150557 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: method: > Jun 16 19:10:10.150557 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: exception: Instance b99da3e1-cab4-41a0-a1e4-6a29efeb77f2 could not be found. Jun 16 19:10:10.150557 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: action_args: {'id': 'b99da3e1-cab4-41a0-a1e4-6a29efeb77f2'} Jun 16 19:10:10.151642 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:10:10.151642 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:10:10.151642 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:10:10.151642 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:10:10.151642 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:10:10.151642 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:10:10.151642 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:10:10.151642 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:10:10.151642 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:10:10.151642 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:10:10.151642 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b99da3e1-cab4-41a0-a1e4-6a29efeb77f2 could not be found. Jun 16 19:10:10.151642 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:10:10.151642 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:10:10.151642 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:10:10.151642 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:10:10.151642 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:10:10.151642 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:10:10.151642 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:10:10.151642 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:10:10.151642 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:10:10.153211 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:10:10.153211 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:10:10.153211 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:10:10.153211 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:10:10.153211 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:10:10.153211 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:10:10.153211 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:10:10.153211 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b99da3e1-cab4-41a0-a1e4-6a29efeb77f2 could not be found. Jun 16 19:10:10.153211 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:10:10.153211 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:10:10.153211 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:10:10.153211 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:10:10.153211 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:10:10.153211 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:10:10.153211 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:10:10.153211 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:10:10.153211 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b99da3e1-cab4-41a0-a1e4-6a29efeb77f2 could not be found. Jun 16 19:10:10.153211 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:10:10.154503 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-fba32be7-d025-44c8-9088-fb29880e91f6 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Returning 404 to user: Instance b99da3e1-cab4-41a0-a1e4-6a29efeb77f2 could not be found. {{(pid=117852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:10:10.154503 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-fba32be7-d025-44c8-9088-fb29880e91f6 tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2" status: 404 len: 111 microversion: 2.1 time: 0.028540 Jun 16 19:10:10.154503 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 561/1103] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:10:10 2022] GET /compute/v2.1/servers/b99da3e1-cab4-41a0-a1e4-6a29efeb77f2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:10:10.980379 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-6dd843b0-c219-44f0-98cd-138d71cd6eda tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:10:10.981018 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-6dd843b0-c219-44f0-98cd-138d71cd6eda tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 084c800e-8268-42d5-8c08-89be0077e1a3] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:10:10.990746 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-6dd843b0-c219-44f0-98cd-138d71cd6eda tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:10.991214 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-6dd843b0-c219-44f0-98cd-138d71cd6eda tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:10.992030 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-6dd843b0-c219-44f0-98cd-138d71cd6eda tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:10.992498 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-6dd843b0-c219-44f0-98cd-138d71cd6eda tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:11.127388 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-6dd843b0-c219-44f0-98cd-138d71cd6eda tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f5aba8355c436b94508156bca24ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf39ecb69ea7474d940ad17f8bab4874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:10:11.135527 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-6dd843b0-c219-44f0-98cd-138d71cd6eda tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/084c800e-8268-42d5-8c08-89be0077e1a3" status: 200 len: 1555 microversion: 2.1 time: 0.159082 Jun 16 19:10:11.136079 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 543/1104] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:10:10 2022] GET /compute/v2.1/servers/084c800e-8268-42d5-8c08-89be0077e1a3 => generated 1555 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:10:11.151843 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-52861f69-572d-42d5-b2d9-07e1bcad277f tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:10:11.152664 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-52861f69-572d-42d5-b2d9-07e1bcad277f tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 084c800e-8268-42d5-8c08-89be0077e1a3] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:10:11.159050 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-52861f69-572d-42d5-b2d9-07e1bcad277f tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:11.159499 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-52861f69-572d-42d5-b2d9-07e1bcad277f tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:11.160264 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-52861f69-572d-42d5-b2d9-07e1bcad277f tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:11.160700 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-52861f69-572d-42d5-b2d9-07e1bcad277f tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:11.242532 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-52861f69-572d-42d5-b2d9-07e1bcad277f tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/084c800e-8268-42d5-8c08-89be0077e1a3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094554 Jun 16 19:10:11.243162 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 562/1105] 10.222.0.70 () {58 vars in 1274 bytes} [Thu Jun 16 19:10:11 2022] GET /compute/v2.1/servers/084c800e-8268-42d5-8c08-89be0077e1a3/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:10:11.444603 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-83c427a7-d4b1-496e-a39f-db9390022b0f tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] Calling method '.version_select at 0x7f12e5deb430>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:10:11.465513 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-83c427a7-d4b1-496e-a39f-db9390022b0f tempest-TestVolumeBootPattern-1500718300 tempest-TestVolumeBootPattern-1500718300-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-550046181" status: 202 len: 0 microversion: 2.1 time: 0.024815 Jun 16 19:10:11.466945 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 544/1106] 10.222.0.70 () {58 vars in 1259 bytes} [Thu Jun 16 19:10:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-550046181 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 19:10:12.485174 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [req-9f84c501-7241-4ff5-8390-163fbe6c15a1 req-e83e8e7c-2604-4251-b0c1-be7f42f5280d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "084c800e-8268-42d5-8c08-89be0077e1a3", "tag": "0d77ff6f-2b80-4f10-bf28-ef19e0e28979"}]} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:10:12.495713 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-9f84c501-7241-4ff5-8390-163fbe6c15a1 req-e83e8e7c-2604-4251-b0c1-be7f42f5280d service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:12.496156 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-9f84c501-7241-4ff5-8390-163fbe6c15a1 req-e83e8e7c-2604-4251-b0c1-be7f42f5280d service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:12.509163 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.compute.server_external_events [req-9f84c501-7241-4ff5-8390-163fbe6c15a1 req-e83e8e7c-2604-4251-b0c1-be7f42f5280d service nova] Creating event network-changed:0d77ff6f-2b80-4f10-bf28-ef19e0e28979 for instance 084c800e-8268-42d5-8c08-89be0077e1a3 on hv-cinder-84617 Jun 16 19:10:12.515873 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [req-9f84c501-7241-4ff5-8390-163fbe6c15a1 req-e83e8e7c-2604-4251-b0c1-be7f42f5280d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034905 Jun 16 19:10:12.516545 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 563/1107] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:10:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:10:50.610211 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-44c4fb1d-887d-4036-8bd5-7568187c4487 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:10:50.610860 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-44c4fb1d-887d-4036-8bd5-7568187c4487 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 084c800e-8268-42d5-8c08-89be0077e1a3] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:10:50.612938 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_cell1:SELECT=44 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:10:50.613575 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=3,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:10:50.620882 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-44c4fb1d-887d-4036-8bd5-7568187c4487 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:50.621338 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-44c4fb1d-887d-4036-8bd5-7568187c4487 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:50.622107 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-44c4fb1d-887d-4036-8bd5-7568187c4487 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:50.622544 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-44c4fb1d-887d-4036-8bd5-7568187c4487 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:50.648331 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-44c4fb1d-887d-4036-8bd5-7568187c4487 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/084c800e-8268-42d5-8c08-89be0077e1a3/ips" status: 200 len: 148 microversion: 2.1 time: 0.042187 Jun 16 19:10:50.650849 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 545/1108] 10.222.0.70 () {58 vars in 1247 bytes} [Thu Jun 16 19:10:50 2022] GET /compute/v2.1/servers/084c800e-8268-42d5-8c08-89be0077e1a3/ips => generated 148 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:10:51.980967 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:10:51.981705 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_cell1:SELECT=32 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:10:51.985918 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-4551cc48-c1ed-45cc-b2dd-b586b2c625eb tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7fa547db-990d-472f-ac6e-8d446e5c9548"}} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:10:51.987089 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-4551cc48-c1ed-45cc-b2dd-b586b2c625eb tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 084c800e-8268-42d5-8c08-89be0077e1a3] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:10:51.994961 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-4551cc48-c1ed-45cc-b2dd-b586b2c625eb tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:51.995404 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-4551cc48-c1ed-45cc-b2dd-b586b2c625eb tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:51.996163 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-4551cc48-c1ed-45cc-b2dd-b586b2c625eb tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:51.996599 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-4551cc48-c1ed-45cc-b2dd-b586b2c625eb tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:52.242116 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-4551cc48-c1ed-45cc-b2dd-b586b2c625eb tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "POST /compute/v2.1/servers/084c800e-8268-42d5-8c08-89be0077e1a3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.262647 Jun 16 19:10:52.243656 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 564/1109] 10.222.0.70 () {60 vars in 1322 bytes} [Thu Jun 16 19:10:51 2022] POST /compute/v2.1/servers/084c800e-8268-42d5-8c08-89be0077e1a3/os-volume_attachments => generated 194 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:10:59.764034 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-622dc337-82e7-4a28-b95f-8305af98f783 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7fa547db-990d-472f-ac6e-8d446e5c9548"}} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:10:59.765101 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-622dc337-82e7-4a28-b95f-8305af98f783 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 084c800e-8268-42d5-8c08-89be0077e1a3] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:10:59.771694 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-622dc337-82e7-4a28-b95f-8305af98f783 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:59.772137 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-622dc337-82e7-4a28-b95f-8305af98f783 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:59.772895 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-622dc337-82e7-4a28-b95f-8305af98f783 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:59.773330 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-622dc337-82e7-4a28-b95f-8305af98f783 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:59.855783 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.wsgi [None req-622dc337-82e7-4a28-b95f-8305af98f783 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] HTTP exception thrown: Invalid volume: volume 7fa547db-990d-472f-ac6e-8d446e5c9548 is already attached to instances: 084c800e-8268-42d5-8c08-89be0077e1a3 Jun 16 19:10:59.857506 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-622dc337-82e7-4a28-b95f-8305af98f783 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Request method failure captured: Jun 16 19:10:59.857506 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: request: POST /compute/v2.1/servers/084c800e-8268-42d5-8c08-89be0077e1a3/os-volume_attachments HTTP/1.1 Jun 16 19:10:59.857506 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Accept: application/json Jun 16 19:10:59.857506 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Accept-Encoding: identity Jun 16 19:10:59.857506 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Connection: close Jun 16 19:10:59.857506 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Content-Length: 74 Jun 16 19:10:59.857506 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Content-Type: application/json Jun 16 19:10:59.857506 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Host: 10.222.0.70 Jun 16 19:10:59.857506 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Openstack-System-Scope: None Jun 16 19:10:59.857506 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: User-Agent: python-urllib3/1.26.9 Jun 16 19:10:59.857506 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Auth-Token: gAAAAABiq397T4ON-zQSBMJgTjz79-0rWbCf9bpfcP8v-Jb0yUpscjKugrXoi0b22yw1HJ_i1bTu9MeeX2PCjDS1AXbAoxSR6e2OSDrQ63ej8My_EvvhndYrxtwl3jqGomk9A-ziExtrOqReYSW9IwopSACLPtaotkV-uvvWqsg4A20E92OPpA0 Jun 16 19:10:59.857506 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Domain-Id: None Jun 16 19:10:59.857506 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Domain-Name: None Jun 16 19:10:59.857506 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Identity-Status: Confirmed Jun 16 19:10:59.857506 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Is-Admin-Project: True Jun 16 19:10:59.857506 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Domain-Id: default Jun 16 19:10:59.857506 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Domain-Name: Default Jun 16 19:10:59.857506 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Id: bf39ecb69ea7474d940ad17f8bab4874 Jun 16 19:10:59.857506 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Name: tempest-AttachVolumeNegativeTest-1452215888 Jun 16 19:10:59.857506 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Role: member,reader Jun 16 19:10:59.857506 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Roles: member,reader Jun 16 19:10:59.859243 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/bf39ecb69ea7474d940ad17f8bab4874"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_bf39ecb69ea7474d940ad17f8bab4874", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/bf39ecb69ea7474d940ad17f8bab4874"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/bf39ecb69ea7474d940ad17f8bab4874"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 16 19:10:59.859243 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant: tempest-AttachVolumeNegativeTest-1452215888 Jun 16 19:10:59.859243 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant-Id: bf39ecb69ea7474d940ad17f8bab4874 Jun 16 19:10:59.859243 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1452215888 Jun 16 19:10:59.859243 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User: tempest-AttachVolumeNegativeTest-1452215888-project Jun 16 19:10:59.859243 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Domain-Id: default Jun 16 19:10:59.859243 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Domain-Name: Default Jun 16 19:10:59.859243 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Id: 55f5aba8355c436b94508156bca24ab3 Jun 16 19:10:59.859243 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Name: tempest-AttachVolumeNegativeTest-1452215888-project Jun 16 19:10:59.859243 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Jun 16 19:10:59.859243 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: {"volumeAttachment": {"volumeId": "7fa547db-990d-472f-ac6e-8d446e5c9548"}} Jun 16 19:10:59.859243 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: method: > Jun 16 19:10:59.860378 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: exception: Invalid volume: volume 7fa547db-990d-472f-ac6e-8d446e5c9548 is already attached to instances: 084c800e-8268-42d5-8c08-89be0077e1a3 Jun 16 19:10:59.860378 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: action_args: {'server_id': '084c800e-8268-42d5-8c08-89be0077e1a3', 'body': {'volumeAttachment': {'volumeId': '7fa547db-990d-472f-ac6e-8d446e5c9548'}}} Jun 16 19:10:59.860378 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:10:59.860378 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:10:59.860378 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 16 19:10:59.860378 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 16 19:10:59.860378 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 19:10:59.860378 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 19:10:59.860378 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 16 19:10:59.860378 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 16 19:10:59.860378 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 16 19:10:59.860378 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 16 19:10:59.860378 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 16 19:10:59.860378 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 16 19:10:59.860378 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 7fa547db-990d-472f-ac6e-8d446e5c9548 is already attached to instances: 084c800e-8268-42d5-8c08-89be0077e1a3 Jun 16 19:10:59.860378 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:10:59.860378 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:10:59.860378 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:10:59.860378 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:10:59.861893 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:10:59.861893 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:10:59.861893 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:10:59.861893 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:10:59.861893 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:10:59.861893 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:10:59.861893 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 19:10:59.861893 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 19:10:59.861893 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 19:10:59.861893 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 19:10:59.861893 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 19:10:59.861893 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 19:10:59.861893 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 16 19:10:59.861893 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 16 19:10:59.861893 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 7fa547db-990d-472f-ac6e-8d446e5c9548 is already attached to instances: 084c800e-8268-42d5-8c08-89be0077e1a3 Jun 16 19:10:59.861893 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:10:59.861893 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:10:59.861893 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:10:59.861893 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:10:59.861893 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:10:59.864034 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:10:59.864034 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:10:59.864034 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:10:59.864034 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 7fa547db-990d-472f-ac6e-8d446e5c9548 is already attached to instances: 084c800e-8268-42d5-8c08-89be0077e1a3 Jun 16 19:10:59.864034 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:10:59.864034 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-622dc337-82e7-4a28-b95f-8305af98f783 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Returning 400 to user: Invalid volume: volume 7fa547db-990d-472f-ac6e-8d446e5c9548 is already attached to instances: 084c800e-8268-42d5-8c08-89be0077e1a3 {{(pid=117850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:10:59.864034 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-622dc337-82e7-4a28-b95f-8305af98f783 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "POST /compute/v2.1/servers/084c800e-8268-42d5-8c08-89be0077e1a3/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098884 Jun 16 19:10:59.864034 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 546/1110] 10.222.0.70 () {60 vars in 1322 bytes} [Thu Jun 16 19:10:59 2022] POST /compute/v2.1/servers/084c800e-8268-42d5-8c08-89be0077e1a3/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 19:10:59.921257 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-0de01b65-d1c7-44eb-aa07-30d281a9c312 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:10:59.921837 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-0de01b65-d1c7-44eb-aa07-30d281a9c312 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 084c800e-8268-42d5-8c08-89be0077e1a3] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:10:59.928582 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-0de01b65-d1c7-44eb-aa07-30d281a9c312 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:59.929028 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-0de01b65-d1c7-44eb-aa07-30d281a9c312 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:10:59.929781 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-0de01b65-d1c7-44eb-aa07-30d281a9c312 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:10:59.930764 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-0de01b65-d1c7-44eb-aa07-30d281a9c312 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:00.012432 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.objects.instance [None req-0de01b65-d1c7-44eb-aa07-30d281a9c312 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lazy-loading 'services' on Instance uuid 084c800e-8268-42d5-8c08-89be0077e1a3 {{(pid=117852) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:11:00.083392 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-0de01b65-d1c7-44eb-aa07-30d281a9c312 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "DELETE /compute/v2.1/servers/084c800e-8268-42d5-8c08-89be0077e1a3/os-volume_attachments/7fa547db-990d-472f-ac6e-8d446e5c9548" status: 202 len: 0 microversion: 2.1 time: 0.166180 Jun 16 19:11:00.084007 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 565/1111] 10.222.0.70 () {58 vars in 1415 bytes} [Thu Jun 16 19:10:59 2022] DELETE /compute/v2.1/servers/084c800e-8268-42d5-8c08-89be0077e1a3/os-volume_attachments/7fa547db-990d-472f-ac6e-8d446e5c9548 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:11:00.092501 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-0942ad18-3f48-478f-b49b-3dea10e74c54 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:00.093537 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-0942ad18-3f48-478f-b49b-3dea10e74c54 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 084c800e-8268-42d5-8c08-89be0077e1a3] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:00.100721 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0942ad18-3f48-478f-b49b-3dea10e74c54 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:00.101202 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0942ad18-3f48-478f-b49b-3dea10e74c54 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:00.102596 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0942ad18-3f48-478f-b49b-3dea10e74c54 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:00.103069 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-0942ad18-3f48-478f-b49b-3dea10e74c54 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:00.133626 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-0942ad18-3f48-478f-b49b-3dea10e74c54 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/084c800e-8268-42d5-8c08-89be0077e1a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045194 Jun 16 19:11:00.134241 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 547/1112] 10.222.0.70 () {58 vars in 1301 bytes} [Thu Jun 16 19:11:00 2022] GET /compute/v2.1/servers/084c800e-8268-42d5-8c08-89be0077e1a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:11:01.146592 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-697cb804-3cce-4e3c-85ca-811d981cdb70 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:01.147644 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-697cb804-3cce-4e3c-85ca-811d981cdb70 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 084c800e-8268-42d5-8c08-89be0077e1a3] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:01.155068 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-697cb804-3cce-4e3c-85ca-811d981cdb70 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:01.155515 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-697cb804-3cce-4e3c-85ca-811d981cdb70 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:01.156271 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-697cb804-3cce-4e3c-85ca-811d981cdb70 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:01.156701 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-697cb804-3cce-4e3c-85ca-811d981cdb70 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:01.185834 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-697cb804-3cce-4e3c-85ca-811d981cdb70 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/084c800e-8268-42d5-8c08-89be0077e1a3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044120 Jun 16 19:11:01.186442 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 566/1113] 10.222.0.70 () {58 vars in 1301 bytes} [Thu Jun 16 19:11:01 2022] GET /compute/v2.1/servers/084c800e-8268-42d5-8c08-89be0077e1a3/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 19:11:01.243404 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-930995c1-b5d6-4551-bbfe-a8245f8e2816 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:01.244038 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-930995c1-b5d6-4551-bbfe-a8245f8e2816 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 084c800e-8268-42d5-8c08-89be0077e1a3] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:01.250453 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-930995c1-b5d6-4551-bbfe-a8245f8e2816 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:01.250940 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-930995c1-b5d6-4551-bbfe-a8245f8e2816 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:01.251708 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-930995c1-b5d6-4551-bbfe-a8245f8e2816 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:01.252151 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-930995c1-b5d6-4551-bbfe-a8245f8e2816 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:01.278178 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-930995c1-b5d6-4551-bbfe-a8245f8e2816 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 084c800e-8268-42d5-8c08-89be0077e1a3] Going to try to terminate instance {{(pid=117850) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:11:01.354890 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-930995c1-b5d6-4551-bbfe-a8245f8e2816 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "DELETE /compute/v2.1/servers/084c800e-8268-42d5-8c08-89be0077e1a3" status: 204 len: 0 microversion: 2.1 time: 0.115119 Jun 16 19:11:01.355663 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 548/1114] 10.222.0.70 () {58 vars in 1238 bytes} [Thu Jun 16 19:11:01 2022] DELETE /compute/v2.1/servers/084c800e-8268-42d5-8c08-89be0077e1a3 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:11:01.364379 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-cac120db-8ad3-42fa-913a-c756f2e34185 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:01.365001 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-cac120db-8ad3-42fa-913a-c756f2e34185 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 084c800e-8268-42d5-8c08-89be0077e1a3] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:01.371297 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-cac120db-8ad3-42fa-913a-c756f2e34185 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:01.371775 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-cac120db-8ad3-42fa-913a-c756f2e34185 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:01.372565 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-cac120db-8ad3-42fa-913a-c756f2e34185 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:01.372997 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-cac120db-8ad3-42fa-913a-c756f2e34185 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:01.505145 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-cac120db-8ad3-42fa-913a-c756f2e34185 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f5aba8355c436b94508156bca24ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf39ecb69ea7474d940ad17f8bab4874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:01.512832 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-cac120db-8ad3-42fa-913a-c756f2e34185 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/084c800e-8268-42d5-8c08-89be0077e1a3" status: 200 len: 1679 microversion: 2.1 time: 0.152979 Jun 16 19:11:01.513399 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 567/1115] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:01 2022] GET /compute/v2.1/servers/084c800e-8268-42d5-8c08-89be0077e1a3 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:02.531132 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-2bd20b0a-561b-4c48-9b5f-48ea9bf029b9 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:02.531848 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-2bd20b0a-561b-4c48-9b5f-48ea9bf029b9 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 084c800e-8268-42d5-8c08-89be0077e1a3] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:02.538265 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-2bd20b0a-561b-4c48-9b5f-48ea9bf029b9 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:02.538754 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-2bd20b0a-561b-4c48-9b5f-48ea9bf029b9 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:02.540342 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-2bd20b0a-561b-4c48-9b5f-48ea9bf029b9 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:02.540737 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-2bd20b0a-561b-4c48-9b5f-48ea9bf029b9 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:02.670312 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-2bd20b0a-561b-4c48-9b5f-48ea9bf029b9 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f5aba8355c436b94508156bca24ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf39ecb69ea7474d940ad17f8bab4874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:02.678003 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-2bd20b0a-561b-4c48-9b5f-48ea9bf029b9 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/084c800e-8268-42d5-8c08-89be0077e1a3" status: 200 len: 1679 microversion: 2.1 time: 0.151454 Jun 16 19:11:02.678598 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 549/1116] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:02 2022] GET /compute/v2.1/servers/084c800e-8268-42d5-8c08-89be0077e1a3 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:03.697743 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-2617d3f6-76b7-49b8-aa5a-38e68d029325 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:03.698563 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-2617d3f6-76b7-49b8-aa5a-38e68d029325 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 084c800e-8268-42d5-8c08-89be0077e1a3] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:03.705279 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-2617d3f6-76b7-49b8-aa5a-38e68d029325 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:03.705519 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-2617d3f6-76b7-49b8-aa5a-38e68d029325 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:03.706264 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-2617d3f6-76b7-49b8-aa5a-38e68d029325 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:03.706731 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-2617d3f6-76b7-49b8-aa5a-38e68d029325 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:03.775603 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-2617d3f6-76b7-49b8-aa5a-38e68d029325 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f5aba8355c436b94508156bca24ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf39ecb69ea7474d940ad17f8bab4874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:03.783899 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-2617d3f6-76b7-49b8-aa5a-38e68d029325 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/084c800e-8268-42d5-8c08-89be0077e1a3" status: 200 len: 1612 microversion: 2.1 time: 0.091864 Jun 16 19:11:03.784463 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 568/1117] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:03 2022] GET /compute/v2.1/servers/084c800e-8268-42d5-8c08-89be0077e1a3 => generated 1612 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:04.013111 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [req-97533389-2fe8-4bd1-9262-e1956b79a0f5 req-2d6c831b-a088-464d-8ba0-6ef8aae470dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "084c800e-8268-42d5-8c08-89be0077e1a3", "name": "network-vif-deleted", "tag": "0d77ff6f-2b80-4f10-bf28-ef19e0e28979"}]} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:11:04.022625 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-97533389-2fe8-4bd1-9262-e1956b79a0f5 req-2d6c831b-a088-464d-8ba0-6ef8aae470dd service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:04.023086 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-97533389-2fe8-4bd1-9262-e1956b79a0f5 req-2d6c831b-a088-464d-8ba0-6ef8aae470dd service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:04.035480 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.compute.server_external_events [req-97533389-2fe8-4bd1-9262-e1956b79a0f5 req-2d6c831b-a088-464d-8ba0-6ef8aae470dd service nova] Creating event network-vif-deleted:0d77ff6f-2b80-4f10-bf28-ef19e0e28979 for instance 084c800e-8268-42d5-8c08-89be0077e1a3 on hv-cinder-84617 Jun 16 19:11:04.041622 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [req-97533389-2fe8-4bd1-9262-e1956b79a0f5 req-2d6c831b-a088-464d-8ba0-6ef8aae470dd service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032173 Jun 16 19:11:04.043297 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 550/1118] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:11:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:11:04.801364 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-5cc246c6-2dab-460b-9a05-223069a64583 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:04.801983 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-5cc246c6-2dab-460b-9a05-223069a64583 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 084c800e-8268-42d5-8c08-89be0077e1a3] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:04.808887 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-5cc246c6-2dab-460b-9a05-223069a64583 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:04.809344 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-5cc246c6-2dab-460b-9a05-223069a64583 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:04.810125 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-5cc246c6-2dab-460b-9a05-223069a64583 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:04.810599 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-5cc246c6-2dab-460b-9a05-223069a64583 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:04.825316 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.wsgi [None req-5cc246c6-2dab-460b-9a05-223069a64583 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] HTTP exception thrown: Instance 084c800e-8268-42d5-8c08-89be0077e1a3 could not be found. Jun 16 19:11:04.827185 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-5cc246c6-2dab-460b-9a05-223069a64583 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Request method failure captured: Jun 16 19:11:04.827185 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: request: GET /compute/v2.1/servers/084c800e-8268-42d5-8c08-89be0077e1a3 HTTP/1.1 Jun 16 19:11:04.827185 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Accept: application/json Jun 16 19:11:04.827185 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Accept-Encoding: identity Jun 16 19:11:04.827185 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Connection: close Jun 16 19:11:04.827185 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Content-Length: 0 Jun 16 19:11:04.827185 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Content-Type: application/json Jun 16 19:11:04.827185 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Host: 10.222.0.70 Jun 16 19:11:04.827185 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Openstack-System-Scope: None Jun 16 19:11:04.827185 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: User-Agent: python-urllib3/1.26.9 Jun 16 19:11:04.827185 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Auth-Token: gAAAAABiq397T4ON-zQSBMJgTjz79-0rWbCf9bpfcP8v-Jb0yUpscjKugrXoi0b22yw1HJ_i1bTu9MeeX2PCjDS1AXbAoxSR6e2OSDrQ63ej8My_EvvhndYrxtwl3jqGomk9A-ziExtrOqReYSW9IwopSACLPtaotkV-uvvWqsg4A20E92OPpA0 Jun 16 19:11:04.827185 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Domain-Id: None Jun 16 19:11:04.827185 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Domain-Name: None Jun 16 19:11:04.827185 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Identity-Status: Confirmed Jun 16 19:11:04.827185 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Is-Admin-Project: True Jun 16 19:11:04.827185 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Domain-Id: default Jun 16 19:11:04.827185 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Domain-Name: Default Jun 16 19:11:04.827185 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Id: bf39ecb69ea7474d940ad17f8bab4874 Jun 16 19:11:04.827185 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Name: tempest-AttachVolumeNegativeTest-1452215888 Jun 16 19:11:04.827185 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Role: member,reader Jun 16 19:11:04.827185 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Roles: member,reader Jun 16 19:11:04.828922 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/bf39ecb69ea7474d940ad17f8bab4874"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_bf39ecb69ea7474d940ad17f8bab4874", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/bf39ecb69ea7474d940ad17f8bab4874"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/bf39ecb69ea7474d940ad17f8bab4874"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 16 19:11:04.828922 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant: tempest-AttachVolumeNegativeTest-1452215888 Jun 16 19:11:04.828922 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant-Id: bf39ecb69ea7474d940ad17f8bab4874 Jun 16 19:11:04.828922 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1452215888 Jun 16 19:11:04.828922 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User: tempest-AttachVolumeNegativeTest-1452215888-project Jun 16 19:11:04.828922 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Domain-Id: default Jun 16 19:11:04.828922 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Domain-Name: Default Jun 16 19:11:04.828922 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Id: 55f5aba8355c436b94508156bca24ab3 Jun 16 19:11:04.828922 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Name: tempest-AttachVolumeNegativeTest-1452215888-project Jun 16 19:11:04.828922 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: method: > Jun 16 19:11:04.828922 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: exception: Instance 084c800e-8268-42d5-8c08-89be0077e1a3 could not be found. Jun 16 19:11:04.828922 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: action_args: {'id': '084c800e-8268-42d5-8c08-89be0077e1a3'} Jun 16 19:11:04.829816 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:11:04.829816 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:11:04.829816 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:11:04.829816 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:11:04.829816 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:11:04.829816 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:11:04.829816 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:11:04.829816 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:11:04.829816 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:11:04.829816 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:11:04.829816 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 084c800e-8268-42d5-8c08-89be0077e1a3 could not be found. Jun 16 19:11:04.829816 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:11:04.829816 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:11:04.829816 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:11:04.829816 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:11:04.829816 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:11:04.829816 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:11:04.829816 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:11:04.829816 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:11:04.829816 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:11:04.831417 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:11:04.831417 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:11:04.831417 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:11:04.831417 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:11:04.831417 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:11:04.831417 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:11:04.831417 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:11:04.831417 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 084c800e-8268-42d5-8c08-89be0077e1a3 could not be found. Jun 16 19:11:04.831417 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:11:04.831417 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:11:04.831417 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:11:04.831417 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:11:04.831417 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:11:04.831417 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:11:04.831417 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:11:04.831417 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:11:04.831417 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 084c800e-8268-42d5-8c08-89be0077e1a3 could not be found. Jun 16 19:11:04.831417 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:11:04.833031 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-5cc246c6-2dab-460b-9a05-223069a64583 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Returning 404 to user: Instance 084c800e-8268-42d5-8c08-89be0077e1a3 could not be found. {{(pid=117852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:11:04.833031 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-5cc246c6-2dab-460b-9a05-223069a64583 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/084c800e-8268-42d5-8c08-89be0077e1a3" status: 404 len: 111 microversion: 2.1 time: 0.031262 Jun 16 19:11:04.833031 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 569/1119] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:04 2022] GET /compute/v2.1/servers/084c800e-8268-42d5-8c08-89be0077e1a3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:11:04.839227 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-4d455391-003c-4123-afe7-cd2f9a2cacbc tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '.version_select at 0x7f12e67581f0>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:04.859428 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-4d455391-003c-4123-afe7-cd2f9a2cacbc tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1668673222" status: 202 len: 0 microversion: 2.1 time: 0.025451 Jun 16 19:11:04.860024 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 551/1120] 10.222.0.70 () {58 vars in 1220 bytes} [Thu Jun 16 19:11:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1668673222 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:11:05.521475 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-f88a477c-a773-415e-b446-af4abfa70730 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Action: 'create', calling method: .version_select at 0x7f12e5e40670>, body: {"keypair": {"name": "tempest-keypair-1383847455", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHVf1Fv454PatDIPRFfk9w/8GidRz7OKDGgImF6VP/fJ+652TQ+C9mFSnr1dmAaIF9tnyqzfD+NwUuHb5XCL6lOfqO17qjNPH0P72iL+3ijqDLiN065iSaM7eqGW/Gzs3g=="}} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:11:05.536377 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.quota [None req-f88a477c-a773-415e-b446-af4abfa70730 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Getting quotas for project bf39ecb69ea7474d940ad17f8bab4874. Resources: {'key_pairs'} {{(pid=117852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:11:05.541258 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.quota [None req-f88a477c-a773-415e-b446-af4abfa70730 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Getting quotas for user 55f5aba8355c436b94508156bca24ab3 and project bf39ecb69ea7474d940ad17f8bab4874. Resources: {'key_pairs'} {{(pid=117852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:11:05.564358 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-f88a477c-a773-415e-b446-af4abfa70730 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046842 Jun 16 19:11:05.564993 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 570/1121] 10.222.0.70 () {60 vars in 1158 bytes} [Thu Jun 16 19:11:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:11:06.902423 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-51d63755-1398-45da-9b5c-7361caed482d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-58598093", "imageRef": "1d993e69-7f01-4fe0-ba52-0eae2fa43ddf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "16a4eb33-8dce-42a9-8f45-666580159bfa"}], "security_groups": [{"name": "tempest-securitygroup--2075651903"}], "key_name": "tempest-keypair-1383847455", "user_data": "}} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:11:07.021518 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.network.neutron [None req-51d63755-1398-45da-9b5c-7361caed482d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] validate_networks() for [('16a4eb33-8dce-42a9-8f45-666580159bfa', None, None, None, None, None)] {{(pid=117850) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 19:11:07.539084 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-51d63755-1398-45da-9b5c-7361caed482d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Flavor limits 0:0:0 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 19:11:07.540068 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-51d63755-1398-45da-9b5c-7361caed482d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Image limits 0:0:0 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 19:11:07.540549 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-51d63755-1398-45da-9b5c-7361caed482d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Flavor pref 0:0:0 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 19:11:07.540960 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-51d63755-1398-45da-9b5c-7361caed482d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Image pref 0:0:0 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 19:11:07.541374 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.virt.hardware [None req-51d63755-1398-45da-9b5c-7361caed482d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 19:11:07.550304 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-51d63755-1398-45da-9b5c-7361caed482d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:07.550929 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-51d63755-1398-45da-9b5c-7361caed482d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:07.551741 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-51d63755-1398-45da-9b5c-7361caed482d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:07.552182 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-51d63755-1398-45da-9b5c-7361caed482d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:07.569467 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.quota [None req-51d63755-1398-45da-9b5c-7361caed482d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Getting quotas for project bf39ecb69ea7474d940ad17f8bab4874. Resources: {'cores', 'ram', 'instances'} {{(pid=117850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 19:11:07.573736 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.quota [None req-51d63755-1398-45da-9b5c-7361caed482d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Getting quotas for user 55f5aba8355c436b94508156bca24ab3 and project bf39ecb69ea7474d940ad17f8bab4874. Resources: {'cores', 'ram', 'instances'} {{(pid=117850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 19:11:07.584560 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-51d63755-1398-45da-9b5c-7361caed482d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Going to run 1 instances... {{(pid=117850) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 19:11:07.587139 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-51d63755-1398-45da-9b5c-7361caed482d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 35afd833-4e3e-4508-87c1-e3ef6621995f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1d993e69-7f01-4fe0-ba52-0eae2fa43ddf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 19:11:07.634013 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-51d63755-1398-45da-9b5c-7361caed482d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.736475 Jun 16 19:11:07.634688 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 552/1122] 10.222.0.70 () {60 vars in 1146 bytes} [Thu Jun 16 19:11:06 2022] POST /compute/v2.1/servers => generated 402 bytes in 738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 19:11:07.646078 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-ef3cd426-f35d-4d23-8de2-c8dd87cebfea tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:07.646873 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-ef3cd426-f35d-4d23-8de2-c8dd87cebfea tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 35afd833-4e3e-4508-87c1-e3ef6621995f] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:07.707168 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-ef3cd426-f35d-4d23-8de2-c8dd87cebfea tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f5aba8355c436b94508156bca24ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf39ecb69ea7474d940ad17f8bab4874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:07.714303 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-ef3cd426-f35d-4d23-8de2-c8dd87cebfea tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/35afd833-4e3e-4508-87c1-e3ef6621995f" status: 200 len: 1240 microversion: 2.1 time: 0.073220 Jun 16 19:11:07.714903 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 571/1123] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:07 2022] GET /compute/v2.1/servers/35afd833-4e3e-4508-87c1-e3ef6621995f => generated 1240 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:08.732775 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-d3f806e9-afc3-443c-95ce-5f645c364808 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:08.733764 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-d3f806e9-afc3-443c-95ce-5f645c364808 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 35afd833-4e3e-4508-87c1-e3ef6621995f] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:08.740729 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d3f806e9-afc3-443c-95ce-5f645c364808 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:08.741175 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d3f806e9-afc3-443c-95ce-5f645c364808 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:08.755728 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d3f806e9-afc3-443c-95ce-5f645c364808 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:08.756187 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-d3f806e9-afc3-443c-95ce-5f645c364808 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:08.848642 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-d3f806e9-afc3-443c-95ce-5f645c364808 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f5aba8355c436b94508156bca24ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf39ecb69ea7474d940ad17f8bab4874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:08.858166 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-d3f806e9-afc3-443c-95ce-5f645c364808 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/35afd833-4e3e-4508-87c1-e3ef6621995f" status: 200 len: 1310 microversion: 2.1 time: 0.130314 Jun 16 19:11:08.858767 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 553/1124] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:08 2022] GET /compute/v2.1/servers/35afd833-4e3e-4508-87c1-e3ef6621995f => generated 1310 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:09.291121 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 19:11:09.291857 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Thu Jun 16 19:11:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 19:11:09.879480 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-95f84b53-7914-4b1b-aa3d-cd3eff7504f9 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:09.880103 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-95f84b53-7914-4b1b-aa3d-cd3eff7504f9 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 35afd833-4e3e-4508-87c1-e3ef6621995f] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:09.887498 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-95f84b53-7914-4b1b-aa3d-cd3eff7504f9 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:09.887938 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-95f84b53-7914-4b1b-aa3d-cd3eff7504f9 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:09.888724 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-95f84b53-7914-4b1b-aa3d-cd3eff7504f9 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:09.889169 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-95f84b53-7914-4b1b-aa3d-cd3eff7504f9 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:10.047035 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-95f84b53-7914-4b1b-aa3d-cd3eff7504f9 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f5aba8355c436b94508156bca24ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf39ecb69ea7474d940ad17f8bab4874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:10.058771 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-95f84b53-7914-4b1b-aa3d-cd3eff7504f9 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/35afd833-4e3e-4508-87c1-e3ef6621995f" status: 200 len: 1366 microversion: 2.1 time: 0.183020 Jun 16 19:11:10.059664 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 572/1125] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:09 2022] GET /compute/v2.1/servers/35afd833-4e3e-4508-87c1-e3ef6621995f => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:10.252334 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [req-036db005-8d7b-4697-8f29-a39d56e4178d req-e7d22abe-90ad-424c-a327-fba603c2d3f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35afd833-4e3e-4508-87c1-e3ef6621995f", "tag": "e75dc5c3-1a40-468f-a2ec-0a8929cb166c"}]} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:11:10.280875 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-036db005-8d7b-4697-8f29-a39d56e4178d req-e7d22abe-90ad-424c-a327-fba603c2d3f8 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:10.281485 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-036db005-8d7b-4697-8f29-a39d56e4178d req-e7d22abe-90ad-424c-a327-fba603c2d3f8 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:10.299616 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.compute.server_external_events [req-036db005-8d7b-4697-8f29-a39d56e4178d req-e7d22abe-90ad-424c-a327-fba603c2d3f8 service nova] Creating event network-changed:e75dc5c3-1a40-468f-a2ec-0a8929cb166c for instance 35afd833-4e3e-4508-87c1-e3ef6621995f on hv-cinder-84617 Jun 16 19:11:10.310132 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [req-036db005-8d7b-4697-8f29-a39d56e4178d req-e7d22abe-90ad-424c-a327-fba603c2d3f8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064823 Jun 16 19:11:10.311776 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 554/1126] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:11:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:11:11.076432 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-1d0ffb79-2bea-4aa7-b6a2-9c5f327f88a2 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:11.076994 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-1d0ffb79-2bea-4aa7-b6a2-9c5f327f88a2 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 35afd833-4e3e-4508-87c1-e3ef6621995f] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:11.083538 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-1d0ffb79-2bea-4aa7-b6a2-9c5f327f88a2 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:11.084029 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-1d0ffb79-2bea-4aa7-b6a2-9c5f327f88a2 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:11.084842 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-1d0ffb79-2bea-4aa7-b6a2-9c5f327f88a2 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:11.085328 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-1d0ffb79-2bea-4aa7-b6a2-9c5f327f88a2 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:11.223438 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-1d0ffb79-2bea-4aa7-b6a2-9c5f327f88a2 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f5aba8355c436b94508156bca24ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf39ecb69ea7474d940ad17f8bab4874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:11.232316 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-1d0ffb79-2bea-4aa7-b6a2-9c5f327f88a2 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/35afd833-4e3e-4508-87c1-e3ef6621995f" status: 200 len: 1366 microversion: 2.1 time: 0.159845 Jun 16 19:11:11.232892 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 573/1127] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:11 2022] GET /compute/v2.1/servers/35afd833-4e3e-4508-87c1-e3ef6621995f => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:12.250162 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-f3917020-bbe1-4b55-a7a9-49095506065b tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:12.250888 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-f3917020-bbe1-4b55-a7a9-49095506065b tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 35afd833-4e3e-4508-87c1-e3ef6621995f] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:12.257539 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-f3917020-bbe1-4b55-a7a9-49095506065b tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:12.258504 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-f3917020-bbe1-4b55-a7a9-49095506065b tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:12.259779 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-f3917020-bbe1-4b55-a7a9-49095506065b tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:12.260240 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-f3917020-bbe1-4b55-a7a9-49095506065b tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:12.394920 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-f3917020-bbe1-4b55-a7a9-49095506065b tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f5aba8355c436b94508156bca24ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf39ecb69ea7474d940ad17f8bab4874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:12.403383 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-f3917020-bbe1-4b55-a7a9-49095506065b tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/35afd833-4e3e-4508-87c1-e3ef6621995f" status: 200 len: 1366 microversion: 2.1 time: 0.157647 Jun 16 19:11:12.403955 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 555/1128] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:12 2022] GET /compute/v2.1/servers/35afd833-4e3e-4508-87c1-e3ef6621995f => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:13.421981 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-797d50f6-e287-4253-92a5-0412755abc43 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:13.422566 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-797d50f6-e287-4253-92a5-0412755abc43 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 35afd833-4e3e-4508-87c1-e3ef6621995f] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:13.429254 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-797d50f6-e287-4253-92a5-0412755abc43 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:13.429708 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-797d50f6-e287-4253-92a5-0412755abc43 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:13.430876 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-797d50f6-e287-4253-92a5-0412755abc43 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:13.431318 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-797d50f6-e287-4253-92a5-0412755abc43 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:13.573711 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-797d50f6-e287-4253-92a5-0412755abc43 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f5aba8355c436b94508156bca24ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf39ecb69ea7474d940ad17f8bab4874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:13.582020 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-797d50f6-e287-4253-92a5-0412755abc43 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/35afd833-4e3e-4508-87c1-e3ef6621995f" status: 200 len: 1366 microversion: 2.1 time: 0.163866 Jun 16 19:11:13.582596 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 574/1129] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:13 2022] GET /compute/v2.1/servers/35afd833-4e3e-4508-87c1-e3ef6621995f => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:14.599697 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-5aa193b5-66af-46d5-9105-3e8a712e7634 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:14.600527 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-5aa193b5-66af-46d5-9105-3e8a712e7634 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 35afd833-4e3e-4508-87c1-e3ef6621995f] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:14.607968 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-5aa193b5-66af-46d5-9105-3e8a712e7634 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:14.608427 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-5aa193b5-66af-46d5-9105-3e8a712e7634 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:14.609298 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-5aa193b5-66af-46d5-9105-3e8a712e7634 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:14.609739 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-5aa193b5-66af-46d5-9105-3e8a712e7634 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:14.749290 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-5aa193b5-66af-46d5-9105-3e8a712e7634 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f5aba8355c436b94508156bca24ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf39ecb69ea7474d940ad17f8bab4874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:14.756832 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-5aa193b5-66af-46d5-9105-3e8a712e7634 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/35afd833-4e3e-4508-87c1-e3ef6621995f" status: 200 len: 1366 microversion: 2.1 time: 0.161050 Jun 16 19:11:14.757401 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 556/1130] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:14 2022] GET /compute/v2.1/servers/35afd833-4e3e-4508-87c1-e3ef6621995f => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:11:15.198840 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [req-6d32bd00-ab3f-465c-beea-6e36a1d2a53e req-9b696059-acb9-4a27-bed0-f3ce2b004261 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35afd833-4e3e-4508-87c1-e3ef6621995f", "name": "network-vif-plugged", "status": "completed", "tag": "e75dc5c3-1a40-468f-a2ec-0a8929cb166c"}]} {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:11:15.208805 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-6d32bd00-ab3f-465c-beea-6e36a1d2a53e req-9b696059-acb9-4a27-bed0-f3ce2b004261 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:15.209253 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [req-6d32bd00-ab3f-465c-beea-6e36a1d2a53e req-9b696059-acb9-4a27-bed0-f3ce2b004261 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:15.221754 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.compute.server_external_events [req-6d32bd00-ab3f-465c-beea-6e36a1d2a53e req-9b696059-acb9-4a27-bed0-f3ce2b004261 service nova] Creating event network-vif-plugged:e75dc5c3-1a40-468f-a2ec-0a8929cb166c for instance 35afd833-4e3e-4508-87c1-e3ef6621995f on hv-cinder-84617 Jun 16 19:11:15.226852 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [req-6d32bd00-ab3f-465c-beea-6e36a1d2a53e req-9b696059-acb9-4a27-bed0-f3ce2b004261 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032972 Jun 16 19:11:15.227565 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 575/1131] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:11:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:11:15.775448 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-ad97e534-10af-41f6-b60a-03c9fb181a75 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:15.775996 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-ad97e534-10af-41f6-b60a-03c9fb181a75 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 35afd833-4e3e-4508-87c1-e3ef6621995f] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:15.782886 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-ad97e534-10af-41f6-b60a-03c9fb181a75 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:15.783338 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-ad97e534-10af-41f6-b60a-03c9fb181a75 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:15.784112 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-ad97e534-10af-41f6-b60a-03c9fb181a75 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:15.784551 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-ad97e534-10af-41f6-b60a-03c9fb181a75 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:15.920548 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-ad97e534-10af-41f6-b60a-03c9fb181a75 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f5aba8355c436b94508156bca24ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf39ecb69ea7474d940ad17f8bab4874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:15.928017 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-ad97e534-10af-41f6-b60a-03c9fb181a75 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/35afd833-4e3e-4508-87c1-e3ef6621995f" status: 200 len: 1366 microversion: 2.1 time: 0.157303 Jun 16 19:11:15.928586 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 557/1132] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:15 2022] GET /compute/v2.1/servers/35afd833-4e3e-4508-87c1-e3ef6621995f => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:16.946907 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-e8679c57-c116-4424-80e5-acf3933aaf10 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:16.947678 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-e8679c57-c116-4424-80e5-acf3933aaf10 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 35afd833-4e3e-4508-87c1-e3ef6621995f] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:16.953962 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-e8679c57-c116-4424-80e5-acf3933aaf10 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:16.954403 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-e8679c57-c116-4424-80e5-acf3933aaf10 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:16.955203 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-e8679c57-c116-4424-80e5-acf3933aaf10 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:16.955633 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-e8679c57-c116-4424-80e5-acf3933aaf10 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:17.114274 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-e8679c57-c116-4424-80e5-acf3933aaf10 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f5aba8355c436b94508156bca24ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf39ecb69ea7474d940ad17f8bab4874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:17.122940 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-e8679c57-c116-4424-80e5-acf3933aaf10 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/35afd833-4e3e-4508-87c1-e3ef6621995f" status: 200 len: 1366 microversion: 2.1 time: 0.181176 Jun 16 19:11:17.123564 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 576/1133] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:16 2022] GET /compute/v2.1/servers/35afd833-4e3e-4508-87c1-e3ef6621995f => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:11:18.143595 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-9630968a-948e-42f1-acd6-4ebad96b9262 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:18.144254 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-9630968a-948e-42f1-acd6-4ebad96b9262 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 35afd833-4e3e-4508-87c1-e3ef6621995f] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:18.146613 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_cell0:SELECT=2 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:11:18.147303 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_cell0:SELECT=6 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:11:18.154125 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-9630968a-948e-42f1-acd6-4ebad96b9262 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:18.154619 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-9630968a-948e-42f1-acd6-4ebad96b9262 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:18.155364 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-9630968a-948e-42f1-acd6-4ebad96b9262 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:18.155830 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-9630968a-948e-42f1-acd6-4ebad96b9262 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:18.302296 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-9630968a-948e-42f1-acd6-4ebad96b9262 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f5aba8355c436b94508156bca24ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf39ecb69ea7474d940ad17f8bab4874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:11:18.314608 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-9630968a-948e-42f1-acd6-4ebad96b9262 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/35afd833-4e3e-4508-87c1-e3ef6621995f" status: 200 len: 1556 microversion: 2.1 time: 0.174560 Jun 16 19:11:18.315610 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 558/1134] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:11:18 2022] GET /compute/v2.1/servers/35afd833-4e3e-4508-87c1-e3ef6621995f => generated 1556 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:11:18.332138 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-2aadc725-6504-41c9-bad2-d1c8bbf5a012 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:18.332782 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-2aadc725-6504-41c9-bad2-d1c8bbf5a012 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 35afd833-4e3e-4508-87c1-e3ef6621995f] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:18.335624 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_cell0:SELECT=6 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:11:18.341126 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-2aadc725-6504-41c9-bad2-d1c8bbf5a012 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:18.341567 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-2aadc725-6504-41c9-bad2-d1c8bbf5a012 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:18.342329 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-2aadc725-6504-41c9-bad2-d1c8bbf5a012 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:18.342800 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-2aadc725-6504-41c9-bad2-d1c8bbf5a012 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:18.441878 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-2aadc725-6504-41c9-bad2-d1c8bbf5a012 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/35afd833-4e3e-4508-87c1-e3ef6621995f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.113527 Jun 16 19:11:18.442457 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 577/1135] 10.222.0.70 () {58 vars in 1274 bytes} [Thu Jun 16 19:11:18 2022] GET /compute/v2.1/servers/35afd833-4e3e-4508-87c1-e3ef6621995f/os-interface => generated 285 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:11:20.039934 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [req-9f376eed-12b2-4905-a538-fa0d3966b488 req-3b25822c-b659-453f-b516-274e30e5774b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35afd833-4e3e-4508-87c1-e3ef6621995f", "tag": "e75dc5c3-1a40-468f-a2ec-0a8929cb166c"}]} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:11:20.049896 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-9f376eed-12b2-4905-a538-fa0d3966b488 req-3b25822c-b659-453f-b516-274e30e5774b service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:20.050539 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-9f376eed-12b2-4905-a538-fa0d3966b488 req-3b25822c-b659-453f-b516-274e30e5774b service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:20.067749 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.compute.server_external_events [req-9f376eed-12b2-4905-a538-fa0d3966b488 req-3b25822c-b659-453f-b516-274e30e5774b service nova] Creating event network-changed:e75dc5c3-1a40-468f-a2ec-0a8929cb166c for instance 35afd833-4e3e-4508-87c1-e3ef6621995f on hv-cinder-84617 Jun 16 19:11:20.073773 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [req-9f376eed-12b2-4905-a538-fa0d3966b488 req-3b25822c-b659-453f-b516-274e30e5774b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.271881 Jun 16 19:11:20.074478 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 559/1136] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:11:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:11:55.815578 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:11:55.816383 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG dbcounter [-] [117852] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:11:55.820508 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-b4fbfd3e-5b62-4902-8bfa-08296255272c tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:11:55.821006 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-b4fbfd3e-5b62-4902-8bfa-08296255272c tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 35afd833-4e3e-4508-87c1-e3ef6621995f] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:55.828390 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-b4fbfd3e-5b62-4902-8bfa-08296255272c tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:55.828892 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-b4fbfd3e-5b62-4902-8bfa-08296255272c tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:55.829709 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-b4fbfd3e-5b62-4902-8bfa-08296255272c tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:55.830148 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-b4fbfd3e-5b62-4902-8bfa-08296255272c tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:55.854831 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-b4fbfd3e-5b62-4902-8bfa-08296255272c tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/35afd833-4e3e-4508-87c1-e3ef6621995f/ips" status: 200 len: 150 microversion: 2.1 time: 0.040630 Jun 16 19:11:55.855397 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 578/1137] 10.222.0.70 () {58 vars in 1247 bytes} [Thu Jun 16 19:11:55 2022] GET /compute/v2.1/servers/35afd833-4e3e-4508-87c1-e3ef6621995f/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:11:57.196526 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:11:57.197278 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG dbcounter [-] [117850] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 19:11:57.202432 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-ab2924ee-7ac2-4d6a-9b12-212280d723ef tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "14e35bfd-631e-465d-8753-d2dc6343e2b1"}} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:11:57.202996 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-ab2924ee-7ac2-4d6a-9b12-212280d723ef tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 35afd833-4e3e-4508-87c1-e3ef6621995f] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:11:57.214639 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-ab2924ee-7ac2-4d6a-9b12-212280d723ef tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:57.215100 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-ab2924ee-7ac2-4d6a-9b12-212280d723ef tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:57.215886 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-ab2924ee-7ac2-4d6a-9b12-212280d723ef tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:11:57.216323 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-ab2924ee-7ac2-4d6a-9b12-212280d723ef tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:11:57.485780 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-ab2924ee-7ac2-4d6a-9b12-212280d723ef tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "POST /compute/v2.1/servers/35afd833-4e3e-4508-87c1-e3ef6621995f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.290764 Jun 16 19:11:57.486481 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 560/1138] 10.222.0.70 () {60 vars in 1322 bytes} [Thu Jun 16 19:11:57 2022] POST /compute/v2.1/servers/35afd833-4e3e-4508-87c1-e3ef6621995f/os-volume_attachments => generated 194 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:12:05.088726 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-220df99a-b9a8-4186-8ee0-433426a01cbc tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:05.089249 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-220df99a-b9a8-4186-8ee0-433426a01cbc tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 35afd833-4e3e-4508-87c1-e3ef6621995f] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:05.095887 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-220df99a-b9a8-4186-8ee0-433426a01cbc tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:05.096343 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-220df99a-b9a8-4186-8ee0-433426a01cbc tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:05.097142 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-220df99a-b9a8-4186-8ee0-433426a01cbc tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:05.097583 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-220df99a-b9a8-4186-8ee0-433426a01cbc tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:05.178146 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.objects.instance [None req-220df99a-b9a8-4186-8ee0-433426a01cbc tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lazy-loading 'services' on Instance uuid 35afd833-4e3e-4508-87c1-e3ef6621995f {{(pid=117852) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 19:12:05.252670 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-220df99a-b9a8-4186-8ee0-433426a01cbc tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "DELETE /compute/v2.1/servers/35afd833-4e3e-4508-87c1-e3ef6621995f/os-volume_attachments/14e35bfd-631e-465d-8753-d2dc6343e2b1" status: 202 len: 0 microversion: 2.1 time: 0.167818 Jun 16 19:12:05.253253 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 579/1139] 10.222.0.70 () {58 vars in 1415 bytes} [Thu Jun 16 19:12:05 2022] DELETE /compute/v2.1/servers/35afd833-4e3e-4508-87c1-e3ef6621995f/os-volume_attachments/14e35bfd-631e-465d-8753-d2dc6343e2b1 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:12:05.263462 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-f14420f7-0798-4400-bde0-1ee895053cba tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:05.264491 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-f14420f7-0798-4400-bde0-1ee895053cba tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 35afd833-4e3e-4508-87c1-e3ef6621995f] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:05.270667 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-f14420f7-0798-4400-bde0-1ee895053cba tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:05.271125 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-f14420f7-0798-4400-bde0-1ee895053cba tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:05.271896 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-f14420f7-0798-4400-bde0-1ee895053cba tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:05.272341 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-f14420f7-0798-4400-bde0-1ee895053cba tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:05.304212 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-f14420f7-0798-4400-bde0-1ee895053cba tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/35afd833-4e3e-4508-87c1-e3ef6621995f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046313 Jun 16 19:12:05.304803 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 561/1140] 10.222.0.70 () {58 vars in 1301 bytes} [Thu Jun 16 19:12:05 2022] GET /compute/v2.1/servers/35afd833-4e3e-4508-87c1-e3ef6621995f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:12:06.316767 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-39fa12ee-9cd5-43fb-b164-abcdfd3d004e tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:06.317774 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-39fa12ee-9cd5-43fb-b164-abcdfd3d004e tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 35afd833-4e3e-4508-87c1-e3ef6621995f] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:06.325165 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-39fa12ee-9cd5-43fb-b164-abcdfd3d004e tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:06.325618 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-39fa12ee-9cd5-43fb-b164-abcdfd3d004e tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:06.326392 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-39fa12ee-9cd5-43fb-b164-abcdfd3d004e tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:06.326862 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-39fa12ee-9cd5-43fb-b164-abcdfd3d004e tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:06.356379 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-39fa12ee-9cd5-43fb-b164-abcdfd3d004e tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/35afd833-4e3e-4508-87c1-e3ef6621995f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044190 Jun 16 19:12:06.356930 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 580/1141] 10.222.0.70 () {58 vars in 1301 bytes} [Thu Jun 16 19:12:06 2022] GET /compute/v2.1/servers/35afd833-4e3e-4508-87c1-e3ef6621995f/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 19:12:06.413974 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-f1763163-58b5-4bd1-b690-7574d436f06e tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:06.414512 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-f1763163-58b5-4bd1-b690-7574d436f06e tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 35afd833-4e3e-4508-87c1-e3ef6621995f] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:06.421466 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-f1763163-58b5-4bd1-b690-7574d436f06e tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:06.421925 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-f1763163-58b5-4bd1-b690-7574d436f06e tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:06.422730 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-f1763163-58b5-4bd1-b690-7574d436f06e tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:06.423172 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-f1763163-58b5-4bd1-b690-7574d436f06e tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:06.449212 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-f1763163-58b5-4bd1-b690-7574d436f06e tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 35afd833-4e3e-4508-87c1-e3ef6621995f] Going to try to terminate instance {{(pid=117850) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 19:12:06.526193 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-f1763163-58b5-4bd1-b690-7574d436f06e tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "DELETE /compute/v2.1/servers/35afd833-4e3e-4508-87c1-e3ef6621995f" status: 204 len: 0 microversion: 2.1 time: 0.115606 Jun 16 19:12:06.526803 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 562/1142] 10.222.0.70 () {58 vars in 1238 bytes} [Thu Jun 16 19:12:06 2022] DELETE /compute/v2.1/servers/35afd833-4e3e-4508-87c1-e3ef6621995f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 19:12:06.536973 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-d139efc7-08ea-4760-babb-f1a9a0234ea3 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:06.537576 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-d139efc7-08ea-4760-babb-f1a9a0234ea3 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 35afd833-4e3e-4508-87c1-e3ef6621995f] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:06.544613 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d139efc7-08ea-4760-babb-f1a9a0234ea3 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:06.545150 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d139efc7-08ea-4760-babb-f1a9a0234ea3 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:06.546186 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d139efc7-08ea-4760-babb-f1a9a0234ea3 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:06.546753 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-d139efc7-08ea-4760-babb-f1a9a0234ea3 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:06.681352 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-d139efc7-08ea-4760-babb-f1a9a0234ea3 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f5aba8355c436b94508156bca24ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf39ecb69ea7474d940ad17f8bab4874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:12:06.689055 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-d139efc7-08ea-4760-babb-f1a9a0234ea3 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/35afd833-4e3e-4508-87c1-e3ef6621995f" status: 200 len: 1681 microversion: 2.1 time: 0.156347 Jun 16 19:12:06.689619 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 581/1143] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:06 2022] GET /compute/v2.1/servers/35afd833-4e3e-4508-87c1-e3ef6621995f => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:12:07.709031 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-1d87b32d-f61f-4431-b1db-bbd14fedb990 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:07.709744 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-1d87b32d-f61f-4431-b1db-bbd14fedb990 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 35afd833-4e3e-4508-87c1-e3ef6621995f] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:07.717350 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-1d87b32d-f61f-4431-b1db-bbd14fedb990 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:07.717800 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-1d87b32d-f61f-4431-b1db-bbd14fedb990 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:07.718563 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-1d87b32d-f61f-4431-b1db-bbd14fedb990 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:07.719025 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-1d87b32d-f61f-4431-b1db-bbd14fedb990 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:07.858993 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.policy [None req-1d87b32d-f61f-4431-b1db-bbd14fedb990 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f5aba8355c436b94508156bca24ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf39ecb69ea7474d940ad17f8bab4874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117850) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:12:07.866728 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-1d87b32d-f61f-4431-b1db-bbd14fedb990 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/35afd833-4e3e-4508-87c1-e3ef6621995f" status: 200 len: 1681 microversion: 2.1 time: 0.162001 Jun 16 19:12:07.867294 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 563/1144] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:07 2022] GET /compute/v2.1/servers/35afd833-4e3e-4508-87c1-e3ef6621995f => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 19:12:08.884612 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-13bcc007-ca0a-449c-b945-01cad05c6780 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:08.885322 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-13bcc007-ca0a-449c-b945-01cad05c6780 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 35afd833-4e3e-4508-87c1-e3ef6621995f] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:08.892367 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-13bcc007-ca0a-449c-b945-01cad05c6780 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:08.892819 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-13bcc007-ca0a-449c-b945-01cad05c6780 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:08.893590 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-13bcc007-ca0a-449c-b945-01cad05c6780 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:08.895051 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-13bcc007-ca0a-449c-b945-01cad05c6780 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:08.969276 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.policy [None req-13bcc007-ca0a-449c-b945-01cad05c6780 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55f5aba8355c436b94508156bca24ab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf39ecb69ea7474d940ad17f8bab4874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117852) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 19:12:08.976911 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-13bcc007-ca0a-449c-b945-01cad05c6780 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/35afd833-4e3e-4508-87c1-e3ef6621995f" status: 200 len: 1613 microversion: 2.1 time: 0.096651 Jun 16 19:12:08.977496 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 582/1145] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:08 2022] GET /compute/v2.1/servers/35afd833-4e3e-4508-87c1-e3ef6621995f => generated 1613 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 19:12:09.186516 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [req-da6250f9-5611-4c94-abbf-eb2f990ccfcf req-54d66af0-a79f-4ffc-8677-6e4e56f5bca3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35afd833-4e3e-4508-87c1-e3ef6621995f", "name": "network-vif-deleted", "tag": "e75dc5c3-1a40-468f-a2ec-0a8929cb166c"}]} {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 19:12:09.201668 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-da6250f9-5611-4c94-abbf-eb2f990ccfcf req-54d66af0-a79f-4ffc-8677-6e4e56f5bca3 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:09.202338 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [req-da6250f9-5611-4c94-abbf-eb2f990ccfcf req-54d66af0-a79f-4ffc-8677-6e4e56f5bca3 service nova] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:09.224882 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.compute.server_external_events [req-da6250f9-5611-4c94-abbf-eb2f990ccfcf req-54d66af0-a79f-4ffc-8677-6e4e56f5bca3 service nova] Creating event network-vif-deleted:e75dc5c3-1a40-468f-a2ec-0a8929cb166c for instance 35afd833-4e3e-4508-87c1-e3ef6621995f on hv-cinder-84617 Jun 16 19:12:09.230270 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [req-da6250f9-5611-4c94-abbf-eb2f990ccfcf req-54d66af0-a79f-4ffc-8677-6e4e56f5bca3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048351 Jun 16 19:12:09.231132 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 564/1146] 10.222.0.70 () {64 vars in 1317 bytes} [Thu Jun 16 19:12:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 19:12:09.996209 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-288813c0-61e1-47e4-a569-26da5fd73e3d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:09.996953 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-288813c0-61e1-47e4-a569-26da5fd73e3d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 35afd833-4e3e-4508-87c1-e3ef6621995f] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:10.003685 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-288813c0-61e1-47e4-a569-26da5fd73e3d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:10.004142 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-288813c0-61e1-47e4-a569-26da5fd73e3d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:10.004929 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-288813c0-61e1-47e4-a569-26da5fd73e3d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:10.005368 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-288813c0-61e1-47e4-a569-26da5fd73e3d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:10.019854 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.wsgi [None req-288813c0-61e1-47e4-a569-26da5fd73e3d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] HTTP exception thrown: Instance 35afd833-4e3e-4508-87c1-e3ef6621995f could not be found. Jun 16 19:12:10.021512 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-288813c0-61e1-47e4-a569-26da5fd73e3d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Request method failure captured: Jun 16 19:12:10.021512 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: request: GET /compute/v2.1/servers/35afd833-4e3e-4508-87c1-e3ef6621995f HTTP/1.1 Jun 16 19:12:10.021512 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Accept: application/json Jun 16 19:12:10.021512 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Accept-Encoding: identity Jun 16 19:12:10.021512 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Connection: close Jun 16 19:12:10.021512 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Content-Length: 0 Jun 16 19:12:10.021512 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Content-Type: application/json Jun 16 19:12:10.021512 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Host: 10.222.0.70 Jun 16 19:12:10.021512 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Openstack-System-Scope: None Jun 16 19:12:10.021512 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: User-Agent: python-urllib3/1.26.9 Jun 16 19:12:10.021512 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Auth-Token: gAAAAABiq397T4ON-zQSBMJgTjz79-0rWbCf9bpfcP8v-Jb0yUpscjKugrXoi0b22yw1HJ_i1bTu9MeeX2PCjDS1AXbAoxSR6e2OSDrQ63ej8My_EvvhndYrxtwl3jqGomk9A-ziExtrOqReYSW9IwopSACLPtaotkV-uvvWqsg4A20E92OPpA0 Jun 16 19:12:10.021512 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Domain-Id: None Jun 16 19:12:10.021512 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Domain-Name: None Jun 16 19:12:10.021512 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Identity-Status: Confirmed Jun 16 19:12:10.021512 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Is-Admin-Project: True Jun 16 19:12:10.021512 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Domain-Id: default Jun 16 19:12:10.021512 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Domain-Name: Default Jun 16 19:12:10.021512 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Id: bf39ecb69ea7474d940ad17f8bab4874 Jun 16 19:12:10.021512 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Name: tempest-AttachVolumeNegativeTest-1452215888 Jun 16 19:12:10.021512 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Role: member,reader Jun 16 19:12:10.021512 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Roles: member,reader Jun 16 19:12:10.023225 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/bf39ecb69ea7474d940ad17f8bab4874"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_bf39ecb69ea7474d940ad17f8bab4874", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/bf39ecb69ea7474d940ad17f8bab4874"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/bf39ecb69ea7474d940ad17f8bab4874"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 16 19:12:10.023225 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant: tempest-AttachVolumeNegativeTest-1452215888 Jun 16 19:12:10.023225 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant-Id: bf39ecb69ea7474d940ad17f8bab4874 Jun 16 19:12:10.023225 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1452215888 Jun 16 19:12:10.023225 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User: tempest-AttachVolumeNegativeTest-1452215888-project Jun 16 19:12:10.023225 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Domain-Id: default Jun 16 19:12:10.023225 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Domain-Name: Default Jun 16 19:12:10.023225 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Id: 55f5aba8355c436b94508156bca24ab3 Jun 16 19:12:10.023225 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Name: tempest-AttachVolumeNegativeTest-1452215888-project Jun 16 19:12:10.023225 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: method: > Jun 16 19:12:10.023225 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: exception: Instance 35afd833-4e3e-4508-87c1-e3ef6621995f could not be found. Jun 16 19:12:10.023225 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: action_args: {'id': '35afd833-4e3e-4508-87c1-e3ef6621995f'} Jun 16 19:12:10.024588 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:12:10.024588 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:12:10.024588 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:12:10.024588 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:12:10.024588 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:12:10.024588 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:12:10.024588 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:12:10.024588 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:12:10.024588 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:12:10.024588 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:12:10.024588 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35afd833-4e3e-4508-87c1-e3ef6621995f could not be found. Jun 16 19:12:10.024588 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:12:10.024588 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:12:10.024588 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:12:10.024588 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:12:10.024588 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:12:10.024588 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:12:10.024588 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:12:10.024588 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:12:10.024588 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:12:10.027061 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:12:10.027061 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:12:10.027061 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:12:10.027061 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:12:10.027061 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:12:10.027061 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:12:10.027061 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:12:10.027061 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35afd833-4e3e-4508-87c1-e3ef6621995f could not be found. Jun 16 19:12:10.027061 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:12:10.027061 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:12:10.027061 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:12:10.027061 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:12:10.027061 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:12:10.027061 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:12:10.027061 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:12:10.027061 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:12:10.027061 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35afd833-4e3e-4508-87c1-e3ef6621995f could not be found. Jun 16 19:12:10.027061 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:12:10.029574 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-288813c0-61e1-47e4-a569-26da5fd73e3d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Returning 404 to user: Instance 35afd833-4e3e-4508-87c1-e3ef6621995f could not be found. {{(pid=117852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:12:10.029574 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-288813c0-61e1-47e4-a569-26da5fd73e3d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/35afd833-4e3e-4508-87c1-e3ef6621995f" status: 404 len: 111 microversion: 2.1 time: 0.031775 Jun 16 19:12:10.029574 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 583/1147] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:09 2022] GET /compute/v2.1/servers/35afd833-4e3e-4508-87c1-e3ef6621995f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:12:10.032658 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-4ca5ec5d-ce7d-40bd-a42b-fb7440fb57f3 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '.version_select at 0x7f12e685ef70>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:10.050837 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-4ca5ec5d-ce7d-40bd-a42b-fb7440fb57f3 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1383847455" status: 202 len: 0 microversion: 2.1 time: 0.022616 Jun 16 19:12:10.051413 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 565/1148] 10.222.0.70 () {58 vars in 1220 bytes} [Thu Jun 16 19:12:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1383847455 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 19:12:11.802711 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-4d674bde-61ff-4f63-9723-7a8fd97ea85f tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:11.803244 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-4d674bde-61ff-4f63-9723-7a8fd97ea85f tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 35afd833-4e3e-4508-87c1-e3ef6621995f] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:11.810595 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-4d674bde-61ff-4f63-9723-7a8fd97ea85f tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:11.811068 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-4d674bde-61ff-4f63-9723-7a8fd97ea85f tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:11.811831 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-4d674bde-61ff-4f63-9723-7a8fd97ea85f tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:11.812270 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-4d674bde-61ff-4f63-9723-7a8fd97ea85f tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:11.827214 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.wsgi [None req-4d674bde-61ff-4f63-9723-7a8fd97ea85f tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] HTTP exception thrown: Instance 35afd833-4e3e-4508-87c1-e3ef6621995f could not be found. Jun 16 19:12:11.828753 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-4d674bde-61ff-4f63-9723-7a8fd97ea85f tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Request method failure captured: Jun 16 19:12:11.828753 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: request: DELETE /compute/v2.1/servers/35afd833-4e3e-4508-87c1-e3ef6621995f HTTP/1.1 Jun 16 19:12:11.828753 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Accept: application/json Jun 16 19:12:11.828753 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Accept-Encoding: identity Jun 16 19:12:11.828753 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Connection: close Jun 16 19:12:11.828753 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Content-Length: 0 Jun 16 19:12:11.828753 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Content-Type: application/json Jun 16 19:12:11.828753 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Host: 10.222.0.70 Jun 16 19:12:11.828753 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Openstack-System-Scope: None Jun 16 19:12:11.828753 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: User-Agent: python-urllib3/1.26.9 Jun 16 19:12:11.828753 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Auth-Token: gAAAAABiq397T4ON-zQSBMJgTjz79-0rWbCf9bpfcP8v-Jb0yUpscjKugrXoi0b22yw1HJ_i1bTu9MeeX2PCjDS1AXbAoxSR6e2OSDrQ63ej8My_EvvhndYrxtwl3jqGomk9A-ziExtrOqReYSW9IwopSACLPtaotkV-uvvWqsg4A20E92OPpA0 Jun 16 19:12:11.828753 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Domain-Id: None Jun 16 19:12:11.828753 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Domain-Name: None Jun 16 19:12:11.828753 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Identity-Status: Confirmed Jun 16 19:12:11.828753 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Is-Admin-Project: True Jun 16 19:12:11.828753 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Domain-Id: default Jun 16 19:12:11.828753 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Domain-Name: Default Jun 16 19:12:11.828753 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Id: bf39ecb69ea7474d940ad17f8bab4874 Jun 16 19:12:11.828753 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Name: tempest-AttachVolumeNegativeTest-1452215888 Jun 16 19:12:11.828753 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Role: member,reader Jun 16 19:12:11.828753 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Roles: member,reader Jun 16 19:12:11.830394 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/bf39ecb69ea7474d940ad17f8bab4874"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_bf39ecb69ea7474d940ad17f8bab4874", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/bf39ecb69ea7474d940ad17f8bab4874"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/bf39ecb69ea7474d940ad17f8bab4874"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 16 19:12:11.830394 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant: tempest-AttachVolumeNegativeTest-1452215888 Jun 16 19:12:11.830394 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant-Id: bf39ecb69ea7474d940ad17f8bab4874 Jun 16 19:12:11.830394 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1452215888 Jun 16 19:12:11.830394 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User: tempest-AttachVolumeNegativeTest-1452215888-project Jun 16 19:12:11.830394 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Domain-Id: default Jun 16 19:12:11.830394 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Domain-Name: Default Jun 16 19:12:11.830394 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Id: 55f5aba8355c436b94508156bca24ab3 Jun 16 19:12:11.830394 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Name: tempest-AttachVolumeNegativeTest-1452215888-project Jun 16 19:12:11.830394 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: method: > Jun 16 19:12:11.830394 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: exception: Instance 35afd833-4e3e-4508-87c1-e3ef6621995f could not be found. Jun 16 19:12:11.830394 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: action_args: {'id': '35afd833-4e3e-4508-87c1-e3ef6621995f'} Jun 16 19:12:11.831362 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:12:11.831362 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:12:11.831362 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:12:11.831362 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:12:11.831362 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:12:11.831362 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:12:11.831362 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:12:11.831362 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:12:11.831362 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:12:11.831362 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:12:11.831362 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35afd833-4e3e-4508-87c1-e3ef6621995f could not be found. Jun 16 19:12:11.831362 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:12:11.831362 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:12:11.831362 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:12:11.831362 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:12:11.831362 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:12:11.831362 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:12:11.831362 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:12:11.831362 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:12:11.831362 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:12:11.832859 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:12:11.832859 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 19:12:11.832859 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 19:12:11.832859 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 19:12:11.832859 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 19:12:11.832859 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:12:11.832859 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:12:11.832859 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:12:11.832859 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:12:11.832859 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35afd833-4e3e-4508-87c1-e3ef6621995f could not be found. Jun 16 19:12:11.832859 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:12:11.832859 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:12:11.832859 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:12:11.832859 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:12:11.832859 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:12:11.832859 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:12:11.832859 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:12:11.832859 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:12:11.832859 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35afd833-4e3e-4508-87c1-e3ef6621995f could not be found. Jun 16 19:12:11.832859 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:12:11.834411 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-4d674bde-61ff-4f63-9723-7a8fd97ea85f tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Returning 404 to user: Instance 35afd833-4e3e-4508-87c1-e3ef6621995f could not be found. {{(pid=117852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:12:11.834411 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-4d674bde-61ff-4f63-9723-7a8fd97ea85f tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "DELETE /compute/v2.1/servers/35afd833-4e3e-4508-87c1-e3ef6621995f" status: 404 len: 111 microversion: 2.1 time: 0.031286 Jun 16 19:12:11.834411 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 584/1149] 10.222.0.70 () {58 vars in 1238 bytes} [Thu Jun 16 19:12:11 2022] DELETE /compute/v2.1/servers/35afd833-4e3e-4508-87c1-e3ef6621995f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:12:11.839562 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-56272aa9-cbcd-4677-b6d2-35c53e590cbf tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:11.840332 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-56272aa9-cbcd-4677-b6d2-35c53e590cbf tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 35afd833-4e3e-4508-87c1-e3ef6621995f] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:11.846422 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-56272aa9-cbcd-4677-b6d2-35c53e590cbf tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:11.846910 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-56272aa9-cbcd-4677-b6d2-35c53e590cbf tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:11.847751 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-56272aa9-cbcd-4677-b6d2-35c53e590cbf tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:11.848269 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-56272aa9-cbcd-4677-b6d2-35c53e590cbf tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:11.863276 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.wsgi [None req-56272aa9-cbcd-4677-b6d2-35c53e590cbf tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] HTTP exception thrown: Instance 35afd833-4e3e-4508-87c1-e3ef6621995f could not be found. Jun 16 19:12:11.864930 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-56272aa9-cbcd-4677-b6d2-35c53e590cbf tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Request method failure captured: Jun 16 19:12:11.864930 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: request: GET /compute/v2.1/servers/35afd833-4e3e-4508-87c1-e3ef6621995f HTTP/1.1 Jun 16 19:12:11.864930 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Accept: application/json Jun 16 19:12:11.864930 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Accept-Encoding: identity Jun 16 19:12:11.864930 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Connection: close Jun 16 19:12:11.864930 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Content-Length: 0 Jun 16 19:12:11.864930 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Content-Type: application/json Jun 16 19:12:11.864930 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Host: 10.222.0.70 Jun 16 19:12:11.864930 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Openstack-System-Scope: None Jun 16 19:12:11.864930 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: User-Agent: python-urllib3/1.26.9 Jun 16 19:12:11.864930 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Auth-Token: gAAAAABiq397T4ON-zQSBMJgTjz79-0rWbCf9bpfcP8v-Jb0yUpscjKugrXoi0b22yw1HJ_i1bTu9MeeX2PCjDS1AXbAoxSR6e2OSDrQ63ej8My_EvvhndYrxtwl3jqGomk9A-ziExtrOqReYSW9IwopSACLPtaotkV-uvvWqsg4A20E92OPpA0 Jun 16 19:12:11.864930 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Domain-Id: None Jun 16 19:12:11.864930 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Domain-Name: None Jun 16 19:12:11.864930 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Identity-Status: Confirmed Jun 16 19:12:11.864930 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Is-Admin-Project: True Jun 16 19:12:11.864930 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Domain-Id: default Jun 16 19:12:11.864930 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Domain-Name: Default Jun 16 19:12:11.864930 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Id: bf39ecb69ea7474d940ad17f8bab4874 Jun 16 19:12:11.864930 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Name: tempest-AttachVolumeNegativeTest-1452215888 Jun 16 19:12:11.864930 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Role: member,reader Jun 16 19:12:11.864930 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Roles: member,reader Jun 16 19:12:11.867085 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/bf39ecb69ea7474d940ad17f8bab4874"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_bf39ecb69ea7474d940ad17f8bab4874", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/bf39ecb69ea7474d940ad17f8bab4874"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/bf39ecb69ea7474d940ad17f8bab4874"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 16 19:12:11.867085 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant: tempest-AttachVolumeNegativeTest-1452215888 Jun 16 19:12:11.867085 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant-Id: bf39ecb69ea7474d940ad17f8bab4874 Jun 16 19:12:11.867085 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1452215888 Jun 16 19:12:11.867085 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User: tempest-AttachVolumeNegativeTest-1452215888-project Jun 16 19:12:11.867085 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Domain-Id: default Jun 16 19:12:11.867085 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Domain-Name: Default Jun 16 19:12:11.867085 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Id: 55f5aba8355c436b94508156bca24ab3 Jun 16 19:12:11.867085 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Name: tempest-AttachVolumeNegativeTest-1452215888-project Jun 16 19:12:11.867085 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: method: > Jun 16 19:12:11.867085 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: exception: Instance 35afd833-4e3e-4508-87c1-e3ef6621995f could not be found. Jun 16 19:12:11.867085 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: action_args: {'id': '35afd833-4e3e-4508-87c1-e3ef6621995f'} Jun 16 19:12:11.868460 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:12:11.868460 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:12:11.868460 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:12:11.868460 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:12:11.868460 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:12:11.868460 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:12:11.868460 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:12:11.868460 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:12:11.868460 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:12:11.868460 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:12:11.868460 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35afd833-4e3e-4508-87c1-e3ef6621995f could not be found. Jun 16 19:12:11.868460 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:12:11.868460 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:12:11.868460 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:12:11.868460 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:12:11.868460 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:12:11.868460 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:12:11.868460 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:12:11.868460 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:12:11.868460 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:12:11.869756 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:12:11.869756 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:12:11.869756 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:12:11.869756 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:12:11.869756 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:12:11.869756 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:12:11.869756 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:12:11.869756 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35afd833-4e3e-4508-87c1-e3ef6621995f could not be found. Jun 16 19:12:11.869756 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:12:11.869756 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:12:11.869756 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:12:11.869756 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:12:11.869756 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:12:11.869756 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:12:11.869756 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:12:11.869756 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:12:11.869756 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35afd833-4e3e-4508-87c1-e3ef6621995f could not be found. Jun 16 19:12:11.869756 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:12:11.871108 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-56272aa9-cbcd-4677-b6d2-35c53e590cbf tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Returning 404 to user: Instance 35afd833-4e3e-4508-87c1-e3ef6621995f could not be found. {{(pid=117850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:12:11.871108 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-56272aa9-cbcd-4677-b6d2-35c53e590cbf tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/35afd833-4e3e-4508-87c1-e3ef6621995f" status: 404 len: 111 microversion: 2.1 time: 0.031640 Jun 16 19:12:11.871108 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 566/1150] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:11 2022] GET /compute/v2.1/servers/35afd833-4e3e-4508-87c1-e3ef6621995f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:12:13.007894 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-ca025c88-e486-4d82-9452-6b444f376774 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:13.009143 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-ca025c88-e486-4d82-9452-6b444f376774 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 084c800e-8268-42d5-8c08-89be0077e1a3] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:13.015909 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ca025c88-e486-4d82-9452-6b444f376774 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:13.016355 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ca025c88-e486-4d82-9452-6b444f376774 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:13.017115 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ca025c88-e486-4d82-9452-6b444f376774 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:13.017557 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-ca025c88-e486-4d82-9452-6b444f376774 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:13.031753 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.wsgi [None req-ca025c88-e486-4d82-9452-6b444f376774 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] HTTP exception thrown: Instance 084c800e-8268-42d5-8c08-89be0077e1a3 could not be found. Jun 16 19:12:13.033281 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-ca025c88-e486-4d82-9452-6b444f376774 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Request method failure captured: Jun 16 19:12:13.033281 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: request: DELETE /compute/v2.1/servers/084c800e-8268-42d5-8c08-89be0077e1a3 HTTP/1.1 Jun 16 19:12:13.033281 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Accept: application/json Jun 16 19:12:13.033281 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Accept-Encoding: identity Jun 16 19:12:13.033281 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Connection: close Jun 16 19:12:13.033281 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Content-Length: 0 Jun 16 19:12:13.033281 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Content-Type: application/json Jun 16 19:12:13.033281 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Host: 10.222.0.70 Jun 16 19:12:13.033281 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Openstack-System-Scope: None Jun 16 19:12:13.033281 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: User-Agent: python-urllib3/1.26.9 Jun 16 19:12:13.033281 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Auth-Token: gAAAAABiq397T4ON-zQSBMJgTjz79-0rWbCf9bpfcP8v-Jb0yUpscjKugrXoi0b22yw1HJ_i1bTu9MeeX2PCjDS1AXbAoxSR6e2OSDrQ63ej8My_EvvhndYrxtwl3jqGomk9A-ziExtrOqReYSW9IwopSACLPtaotkV-uvvWqsg4A20E92OPpA0 Jun 16 19:12:13.033281 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Domain-Id: None Jun 16 19:12:13.033281 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Domain-Name: None Jun 16 19:12:13.033281 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Identity-Status: Confirmed Jun 16 19:12:13.033281 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Is-Admin-Project: True Jun 16 19:12:13.033281 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Domain-Id: default Jun 16 19:12:13.033281 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Domain-Name: Default Jun 16 19:12:13.033281 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Id: bf39ecb69ea7474d940ad17f8bab4874 Jun 16 19:12:13.033281 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Name: tempest-AttachVolumeNegativeTest-1452215888 Jun 16 19:12:13.033281 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Role: member,reader Jun 16 19:12:13.033281 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Roles: member,reader Jun 16 19:12:13.034977 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/bf39ecb69ea7474d940ad17f8bab4874"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_bf39ecb69ea7474d940ad17f8bab4874", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/bf39ecb69ea7474d940ad17f8bab4874"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/bf39ecb69ea7474d940ad17f8bab4874"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 16 19:12:13.034977 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant: tempest-AttachVolumeNegativeTest-1452215888 Jun 16 19:12:13.034977 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant-Id: bf39ecb69ea7474d940ad17f8bab4874 Jun 16 19:12:13.034977 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1452215888 Jun 16 19:12:13.034977 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User: tempest-AttachVolumeNegativeTest-1452215888-project Jun 16 19:12:13.034977 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Domain-Id: default Jun 16 19:12:13.034977 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Domain-Name: Default Jun 16 19:12:13.034977 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Id: 55f5aba8355c436b94508156bca24ab3 Jun 16 19:12:13.034977 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Name: tempest-AttachVolumeNegativeTest-1452215888-project Jun 16 19:12:13.034977 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: method: > Jun 16 19:12:13.034977 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: exception: Instance 084c800e-8268-42d5-8c08-89be0077e1a3 could not be found. Jun 16 19:12:13.034977 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: action_args: {'id': '084c800e-8268-42d5-8c08-89be0077e1a3'} Jun 16 19:12:13.036103 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:12:13.036103 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:12:13.036103 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:12:13.036103 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:12:13.036103 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:12:13.036103 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:12:13.036103 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:12:13.036103 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:12:13.036103 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:12:13.036103 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:12:13.036103 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 084c800e-8268-42d5-8c08-89be0077e1a3 could not be found. Jun 16 19:12:13.036103 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:12:13.036103 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:12:13.036103 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:12:13.036103 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:12:13.036103 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:12:13.036103 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:12:13.036103 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:12:13.036103 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:12:13.036103 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:12:13.037538 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:12:13.037538 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 19:12:13.037538 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 19:12:13.037538 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 19:12:13.037538 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 19:12:13.037538 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:12:13.037538 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:12:13.037538 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:12:13.037538 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:12:13.037538 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 084c800e-8268-42d5-8c08-89be0077e1a3 could not be found. Jun 16 19:12:13.037538 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:12:13.037538 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:12:13.037538 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:12:13.037538 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:12:13.037538 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:12:13.037538 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:12:13.037538 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:12:13.037538 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:12:13.037538 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 084c800e-8268-42d5-8c08-89be0077e1a3 could not be found. Jun 16 19:12:13.037538 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:12:13.039161 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-ca025c88-e486-4d82-9452-6b444f376774 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Returning 404 to user: Instance 084c800e-8268-42d5-8c08-89be0077e1a3 could not be found. {{(pid=117852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:12:13.039161 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-ca025c88-e486-4d82-9452-6b444f376774 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "DELETE /compute/v2.1/servers/084c800e-8268-42d5-8c08-89be0077e1a3" status: 404 len: 111 microversion: 2.1 time: 0.030646 Jun 16 19:12:13.039161 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 585/1151] 10.222.0.70 () {58 vars in 1238 bytes} [Thu Jun 16 19:12:13 2022] DELETE /compute/v2.1/servers/084c800e-8268-42d5-8c08-89be0077e1a3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:12:13.043853 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-03290228-04b7-4c3b-a54b-cae9b503e455 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:13.044475 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-03290228-04b7-4c3b-a54b-cae9b503e455 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 084c800e-8268-42d5-8c08-89be0077e1a3] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:13.050984 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-03290228-04b7-4c3b-a54b-cae9b503e455 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:13.051436 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-03290228-04b7-4c3b-a54b-cae9b503e455 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:13.052198 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-03290228-04b7-4c3b-a54b-cae9b503e455 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:13.052635 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-03290228-04b7-4c3b-a54b-cae9b503e455 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:13.066158 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.wsgi [None req-03290228-04b7-4c3b-a54b-cae9b503e455 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] HTTP exception thrown: Instance 084c800e-8268-42d5-8c08-89be0077e1a3 could not be found. Jun 16 19:12:13.067708 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-03290228-04b7-4c3b-a54b-cae9b503e455 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Request method failure captured: Jun 16 19:12:13.067708 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: request: GET /compute/v2.1/servers/084c800e-8268-42d5-8c08-89be0077e1a3 HTTP/1.1 Jun 16 19:12:13.067708 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Accept: application/json Jun 16 19:12:13.067708 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Accept-Encoding: identity Jun 16 19:12:13.067708 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Connection: close Jun 16 19:12:13.067708 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Content-Length: 0 Jun 16 19:12:13.067708 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Content-Type: application/json Jun 16 19:12:13.067708 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Host: 10.222.0.70 Jun 16 19:12:13.067708 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Openstack-System-Scope: None Jun 16 19:12:13.067708 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: User-Agent: python-urllib3/1.26.9 Jun 16 19:12:13.067708 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Auth-Token: gAAAAABiq397T4ON-zQSBMJgTjz79-0rWbCf9bpfcP8v-Jb0yUpscjKugrXoi0b22yw1HJ_i1bTu9MeeX2PCjDS1AXbAoxSR6e2OSDrQ63ej8My_EvvhndYrxtwl3jqGomk9A-ziExtrOqReYSW9IwopSACLPtaotkV-uvvWqsg4A20E92OPpA0 Jun 16 19:12:13.067708 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Domain-Id: None Jun 16 19:12:13.067708 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Domain-Name: None Jun 16 19:12:13.067708 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Identity-Status: Confirmed Jun 16 19:12:13.067708 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Is-Admin-Project: True Jun 16 19:12:13.067708 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Domain-Id: default Jun 16 19:12:13.067708 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Domain-Name: Default Jun 16 19:12:13.067708 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Id: bf39ecb69ea7474d940ad17f8bab4874 Jun 16 19:12:13.067708 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Name: tempest-AttachVolumeNegativeTest-1452215888 Jun 16 19:12:13.067708 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Role: member,reader Jun 16 19:12:13.067708 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Roles: member,reader Jun 16 19:12:13.069333 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/bf39ecb69ea7474d940ad17f8bab4874"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_bf39ecb69ea7474d940ad17f8bab4874", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/bf39ecb69ea7474d940ad17f8bab4874"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/bf39ecb69ea7474d940ad17f8bab4874"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 16 19:12:13.069333 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant: tempest-AttachVolumeNegativeTest-1452215888 Jun 16 19:12:13.069333 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant-Id: bf39ecb69ea7474d940ad17f8bab4874 Jun 16 19:12:13.069333 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1452215888 Jun 16 19:12:13.069333 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User: tempest-AttachVolumeNegativeTest-1452215888-project Jun 16 19:12:13.069333 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Domain-Id: default Jun 16 19:12:13.069333 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Domain-Name: Default Jun 16 19:12:13.069333 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Id: 55f5aba8355c436b94508156bca24ab3 Jun 16 19:12:13.069333 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Name: tempest-AttachVolumeNegativeTest-1452215888-project Jun 16 19:12:13.069333 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: method: > Jun 16 19:12:13.069333 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: exception: Instance 084c800e-8268-42d5-8c08-89be0077e1a3 could not be found. Jun 16 19:12:13.069333 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: action_args: {'id': '084c800e-8268-42d5-8c08-89be0077e1a3'} Jun 16 19:12:13.070339 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:12:13.070339 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:12:13.070339 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:12:13.070339 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:12:13.070339 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:12:13.070339 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:12:13.070339 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:12:13.070339 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:12:13.070339 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:12:13.070339 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:12:13.070339 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 084c800e-8268-42d5-8c08-89be0077e1a3 could not be found. Jun 16 19:12:13.070339 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:12:13.070339 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:12:13.070339 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:12:13.070339 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:12:13.070339 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:12:13.070339 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:12:13.070339 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:12:13.070339 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:12:13.070339 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:12:13.072400 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:12:13.072400 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:12:13.072400 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:12:13.072400 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:12:13.072400 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:12:13.072400 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:12:13.072400 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:12:13.072400 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 084c800e-8268-42d5-8c08-89be0077e1a3 could not be found. Jun 16 19:12:13.072400 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:12:13.072400 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:12:13.072400 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:12:13.072400 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:12:13.072400 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:12:13.072400 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:12:13.072400 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:12:13.072400 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:12:13.072400 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 084c800e-8268-42d5-8c08-89be0077e1a3 could not be found. Jun 16 19:12:13.072400 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:12:13.073672 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-03290228-04b7-4c3b-a54b-cae9b503e455 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Returning 404 to user: Instance 084c800e-8268-42d5-8c08-89be0077e1a3 could not be found. {{(pid=117850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:12:13.073672 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-03290228-04b7-4c3b-a54b-cae9b503e455 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/084c800e-8268-42d5-8c08-89be0077e1a3" status: 404 len: 111 microversion: 2.1 time: 0.029284 Jun 16 19:12:13.073672 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 567/1152] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:13 2022] GET /compute/v2.1/servers/084c800e-8268-42d5-8c08-89be0077e1a3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:12:13.078511 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-f0bceedc-84f1-411f-b13d-f5f9e1eab596 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:13.079058 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-f0bceedc-84f1-411f-b13d-f5f9e1eab596 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: be3da0ff-e131-41df-b0ae-350e3ccd81c3] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:13.085385 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f0bceedc-84f1-411f-b13d-f5f9e1eab596 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:13.085840 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f0bceedc-84f1-411f-b13d-f5f9e1eab596 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:13.087533 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f0bceedc-84f1-411f-b13d-f5f9e1eab596 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:13.087723 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-f0bceedc-84f1-411f-b13d-f5f9e1eab596 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:13.101100 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.wsgi [None req-f0bceedc-84f1-411f-b13d-f5f9e1eab596 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] HTTP exception thrown: Instance be3da0ff-e131-41df-b0ae-350e3ccd81c3 could not be found. Jun 16 19:12:13.103197 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-f0bceedc-84f1-411f-b13d-f5f9e1eab596 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Request method failure captured: Jun 16 19:12:13.103197 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: request: DELETE /compute/v2.1/servers/be3da0ff-e131-41df-b0ae-350e3ccd81c3 HTTP/1.1 Jun 16 19:12:13.103197 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Accept: application/json Jun 16 19:12:13.103197 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Accept-Encoding: identity Jun 16 19:12:13.103197 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Connection: close Jun 16 19:12:13.103197 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Content-Length: 0 Jun 16 19:12:13.103197 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Content-Type: application/json Jun 16 19:12:13.103197 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Host: 10.222.0.70 Jun 16 19:12:13.103197 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Openstack-System-Scope: None Jun 16 19:12:13.103197 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: User-Agent: python-urllib3/1.26.9 Jun 16 19:12:13.103197 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Auth-Token: gAAAAABiq397T4ON-zQSBMJgTjz79-0rWbCf9bpfcP8v-Jb0yUpscjKugrXoi0b22yw1HJ_i1bTu9MeeX2PCjDS1AXbAoxSR6e2OSDrQ63ej8My_EvvhndYrxtwl3jqGomk9A-ziExtrOqReYSW9IwopSACLPtaotkV-uvvWqsg4A20E92OPpA0 Jun 16 19:12:13.103197 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Domain-Id: None Jun 16 19:12:13.103197 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Domain-Name: None Jun 16 19:12:13.103197 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Identity-Status: Confirmed Jun 16 19:12:13.103197 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Is-Admin-Project: True Jun 16 19:12:13.103197 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Domain-Id: default Jun 16 19:12:13.103197 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Domain-Name: Default Jun 16 19:12:13.103197 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Id: bf39ecb69ea7474d940ad17f8bab4874 Jun 16 19:12:13.103197 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Name: tempest-AttachVolumeNegativeTest-1452215888 Jun 16 19:12:13.103197 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Role: member,reader Jun 16 19:12:13.103197 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Roles: member,reader Jun 16 19:12:13.104820 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/bf39ecb69ea7474d940ad17f8bab4874"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_bf39ecb69ea7474d940ad17f8bab4874", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/bf39ecb69ea7474d940ad17f8bab4874"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/bf39ecb69ea7474d940ad17f8bab4874"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 16 19:12:13.104820 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant: tempest-AttachVolumeNegativeTest-1452215888 Jun 16 19:12:13.104820 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant-Id: bf39ecb69ea7474d940ad17f8bab4874 Jun 16 19:12:13.104820 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1452215888 Jun 16 19:12:13.104820 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User: tempest-AttachVolumeNegativeTest-1452215888-project Jun 16 19:12:13.104820 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Domain-Id: default Jun 16 19:12:13.104820 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Domain-Name: Default Jun 16 19:12:13.104820 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Id: 55f5aba8355c436b94508156bca24ab3 Jun 16 19:12:13.104820 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Name: tempest-AttachVolumeNegativeTest-1452215888-project Jun 16 19:12:13.104820 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: method: > Jun 16 19:12:13.104820 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: exception: Instance be3da0ff-e131-41df-b0ae-350e3ccd81c3 could not be found. Jun 16 19:12:13.104820 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: action_args: {'id': 'be3da0ff-e131-41df-b0ae-350e3ccd81c3'} Jun 16 19:12:13.105794 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:12:13.105794 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:12:13.105794 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:12:13.105794 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:12:13.105794 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:12:13.105794 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:12:13.105794 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:12:13.105794 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:12:13.105794 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:12:13.105794 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:12:13.105794 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be3da0ff-e131-41df-b0ae-350e3ccd81c3 could not be found. Jun 16 19:12:13.105794 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:12:13.105794 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:12:13.105794 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:12:13.105794 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:12:13.105794 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:12:13.105794 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:12:13.105794 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:12:13.105794 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:12:13.105794 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:12:13.107128 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:12:13.107128 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 19:12:13.107128 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 19:12:13.107128 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 19:12:13.107128 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 19:12:13.107128 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:12:13.107128 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:12:13.107128 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:12:13.107128 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:12:13.107128 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be3da0ff-e131-41df-b0ae-350e3ccd81c3 could not be found. Jun 16 19:12:13.107128 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:12:13.107128 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:12:13.107128 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:12:13.107128 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:12:13.107128 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:12:13.107128 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:12:13.107128 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:12:13.107128 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:12:13.107128 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be3da0ff-e131-41df-b0ae-350e3ccd81c3 could not be found. Jun 16 19:12:13.107128 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:12:13.108548 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-f0bceedc-84f1-411f-b13d-f5f9e1eab596 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Returning 404 to user: Instance be3da0ff-e131-41df-b0ae-350e3ccd81c3 could not be found. {{(pid=117852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:12:13.108548 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-f0bceedc-84f1-411f-b13d-f5f9e1eab596 tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "DELETE /compute/v2.1/servers/be3da0ff-e131-41df-b0ae-350e3ccd81c3" status: 404 len: 111 microversion: 2.1 time: 0.029886 Jun 16 19:12:13.108548 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 586/1153] 10.222.0.70 () {58 vars in 1238 bytes} [Thu Jun 16 19:12:13 2022] DELETE /compute/v2.1/servers/be3da0ff-e131-41df-b0ae-350e3ccd81c3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:12:13.112922 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-09bdc91d-cc38-4a4d-b9ed-6e726e3672bb tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:13.113538 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-09bdc91d-cc38-4a4d-b9ed-6e726e3672bb tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: be3da0ff-e131-41df-b0ae-350e3ccd81c3] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:13.119639 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-09bdc91d-cc38-4a4d-b9ed-6e726e3672bb tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:13.120085 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-09bdc91d-cc38-4a4d-b9ed-6e726e3672bb tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:13.120844 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-09bdc91d-cc38-4a4d-b9ed-6e726e3672bb tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:13.121274 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-09bdc91d-cc38-4a4d-b9ed-6e726e3672bb tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:13.136604 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.wsgi [None req-09bdc91d-cc38-4a4d-b9ed-6e726e3672bb tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] HTTP exception thrown: Instance be3da0ff-e131-41df-b0ae-350e3ccd81c3 could not be found. Jun 16 19:12:13.138103 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-09bdc91d-cc38-4a4d-b9ed-6e726e3672bb tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Request method failure captured: Jun 16 19:12:13.138103 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: request: GET /compute/v2.1/servers/be3da0ff-e131-41df-b0ae-350e3ccd81c3 HTTP/1.1 Jun 16 19:12:13.138103 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Accept: application/json Jun 16 19:12:13.138103 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Accept-Encoding: identity Jun 16 19:12:13.138103 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Connection: close Jun 16 19:12:13.138103 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Content-Length: 0 Jun 16 19:12:13.138103 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Content-Type: application/json Jun 16 19:12:13.138103 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Host: 10.222.0.70 Jun 16 19:12:13.138103 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Openstack-System-Scope: None Jun 16 19:12:13.138103 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: User-Agent: python-urllib3/1.26.9 Jun 16 19:12:13.138103 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Auth-Token: gAAAAABiq397T4ON-zQSBMJgTjz79-0rWbCf9bpfcP8v-Jb0yUpscjKugrXoi0b22yw1HJ_i1bTu9MeeX2PCjDS1AXbAoxSR6e2OSDrQ63ej8My_EvvhndYrxtwl3jqGomk9A-ziExtrOqReYSW9IwopSACLPtaotkV-uvvWqsg4A20E92OPpA0 Jun 16 19:12:13.138103 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Domain-Id: None Jun 16 19:12:13.138103 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Domain-Name: None Jun 16 19:12:13.138103 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Identity-Status: Confirmed Jun 16 19:12:13.138103 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Is-Admin-Project: True Jun 16 19:12:13.138103 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Domain-Id: default Jun 16 19:12:13.138103 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Domain-Name: Default Jun 16 19:12:13.138103 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Id: bf39ecb69ea7474d940ad17f8bab4874 Jun 16 19:12:13.138103 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Name: tempest-AttachVolumeNegativeTest-1452215888 Jun 16 19:12:13.138103 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Role: member,reader Jun 16 19:12:13.138103 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Roles: member,reader Jun 16 19:12:13.139758 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/bf39ecb69ea7474d940ad17f8bab4874"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_bf39ecb69ea7474d940ad17f8bab4874", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/bf39ecb69ea7474d940ad17f8bab4874"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/bf39ecb69ea7474d940ad17f8bab4874"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 16 19:12:13.139758 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant: tempest-AttachVolumeNegativeTest-1452215888 Jun 16 19:12:13.139758 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant-Id: bf39ecb69ea7474d940ad17f8bab4874 Jun 16 19:12:13.139758 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1452215888 Jun 16 19:12:13.139758 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User: tempest-AttachVolumeNegativeTest-1452215888-project Jun 16 19:12:13.139758 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Domain-Id: default Jun 16 19:12:13.139758 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Domain-Name: Default Jun 16 19:12:13.139758 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Id: 55f5aba8355c436b94508156bca24ab3 Jun 16 19:12:13.139758 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Name: tempest-AttachVolumeNegativeTest-1452215888-project Jun 16 19:12:13.139758 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: method: > Jun 16 19:12:13.139758 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: exception: Instance be3da0ff-e131-41df-b0ae-350e3ccd81c3 could not be found. Jun 16 19:12:13.139758 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: action_args: {'id': 'be3da0ff-e131-41df-b0ae-350e3ccd81c3'} Jun 16 19:12:13.140875 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:12:13.140875 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:12:13.140875 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:12:13.140875 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:12:13.140875 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:12:13.140875 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:12:13.140875 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:12:13.140875 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:12:13.140875 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:12:13.140875 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:12:13.140875 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be3da0ff-e131-41df-b0ae-350e3ccd81c3 could not be found. Jun 16 19:12:13.140875 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:12:13.140875 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:12:13.140875 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:12:13.140875 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:12:13.140875 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:12:13.140875 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:12:13.140875 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:12:13.140875 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:12:13.140875 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:12:13.142437 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:12:13.142437 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:12:13.142437 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:12:13.142437 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:12:13.142437 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:12:13.142437 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:12:13.142437 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:12:13.142437 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be3da0ff-e131-41df-b0ae-350e3ccd81c3 could not be found. Jun 16 19:12:13.142437 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:12:13.142437 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:12:13.142437 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:12:13.142437 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:12:13.142437 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:12:13.142437 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:12:13.142437 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:12:13.142437 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:12:13.142437 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be3da0ff-e131-41df-b0ae-350e3ccd81c3 could not be found. Jun 16 19:12:13.142437 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:12:13.146289 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-09bdc91d-cc38-4a4d-b9ed-6e726e3672bb tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Returning 404 to user: Instance be3da0ff-e131-41df-b0ae-350e3ccd81c3 could not be found. {{(pid=117850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:12:13.146289 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-09bdc91d-cc38-4a4d-b9ed-6e726e3672bb tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/be3da0ff-e131-41df-b0ae-350e3ccd81c3" status: 404 len: 111 microversion: 2.1 time: 0.030427 Jun 16 19:12:13.146289 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 568/1154] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:13 2022] GET /compute/v2.1/servers/be3da0ff-e131-41df-b0ae-350e3ccd81c3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:12:14.283452 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-575c1f80-efb7-4f1d-abe7-b063780a1d5d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:14.283966 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.compute.api [None req-575c1f80-efb7-4f1d-abe7-b063780a1d5d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 7a805bc0-29bf-4ca0-80b2-e2ee71912d51] Fetching instance by UUID {{(pid=117852) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:14.290619 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-575c1f80-efb7-4f1d-abe7-b063780a1d5d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:14.291073 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-575c1f80-efb7-4f1d-abe7-b063780a1d5d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:14.291842 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-575c1f80-efb7-4f1d-abe7-b063780a1d5d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:14.292287 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG oslo_concurrency.lockutils [None req-575c1f80-efb7-4f1d-abe7-b063780a1d5d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:14.306415 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.wsgi [None req-575c1f80-efb7-4f1d-abe7-b063780a1d5d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] HTTP exception thrown: Instance 7a805bc0-29bf-4ca0-80b2-e2ee71912d51 could not be found. Jun 16 19:12:14.308010 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-575c1f80-efb7-4f1d-abe7-b063780a1d5d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Request method failure captured: Jun 16 19:12:14.308010 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: request: DELETE /compute/v2.1/servers/7a805bc0-29bf-4ca0-80b2-e2ee71912d51 HTTP/1.1 Jun 16 19:12:14.308010 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Accept: application/json Jun 16 19:12:14.308010 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Accept-Encoding: identity Jun 16 19:12:14.308010 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Connection: close Jun 16 19:12:14.308010 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Content-Length: 0 Jun 16 19:12:14.308010 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Content-Type: application/json Jun 16 19:12:14.308010 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Host: 10.222.0.70 Jun 16 19:12:14.308010 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Openstack-System-Scope: None Jun 16 19:12:14.308010 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: User-Agent: python-urllib3/1.26.9 Jun 16 19:12:14.308010 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Auth-Token: gAAAAABiq397T4ON-zQSBMJgTjz79-0rWbCf9bpfcP8v-Jb0yUpscjKugrXoi0b22yw1HJ_i1bTu9MeeX2PCjDS1AXbAoxSR6e2OSDrQ63ej8My_EvvhndYrxtwl3jqGomk9A-ziExtrOqReYSW9IwopSACLPtaotkV-uvvWqsg4A20E92OPpA0 Jun 16 19:12:14.308010 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Domain-Id: None Jun 16 19:12:14.308010 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Domain-Name: None Jun 16 19:12:14.308010 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Identity-Status: Confirmed Jun 16 19:12:14.308010 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Is-Admin-Project: True Jun 16 19:12:14.308010 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Domain-Id: default Jun 16 19:12:14.308010 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Domain-Name: Default Jun 16 19:12:14.308010 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Id: bf39ecb69ea7474d940ad17f8bab4874 Jun 16 19:12:14.308010 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Project-Name: tempest-AttachVolumeNegativeTest-1452215888 Jun 16 19:12:14.308010 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Role: member,reader Jun 16 19:12:14.308010 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Roles: member,reader Jun 16 19:12:14.309682 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/bf39ecb69ea7474d940ad17f8bab4874"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_bf39ecb69ea7474d940ad17f8bab4874", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/bf39ecb69ea7474d940ad17f8bab4874"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/bf39ecb69ea7474d940ad17f8bab4874"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 16 19:12:14.309682 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant: tempest-AttachVolumeNegativeTest-1452215888 Jun 16 19:12:14.309682 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant-Id: bf39ecb69ea7474d940ad17f8bab4874 Jun 16 19:12:14.309682 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1452215888 Jun 16 19:12:14.309682 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User: tempest-AttachVolumeNegativeTest-1452215888-project Jun 16 19:12:14.309682 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Domain-Id: default Jun 16 19:12:14.309682 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Domain-Name: Default Jun 16 19:12:14.309682 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Id: 55f5aba8355c436b94508156bca24ab3 Jun 16 19:12:14.309682 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: X-User-Name: tempest-AttachVolumeNegativeTest-1452215888-project Jun 16 19:12:14.309682 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: method: > Jun 16 19:12:14.309682 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: exception: Instance 7a805bc0-29bf-4ca0-80b2-e2ee71912d51 could not be found. Jun 16 19:12:14.309682 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: action_args: {'id': '7a805bc0-29bf-4ca0-80b2-e2ee71912d51'} Jun 16 19:12:14.310972 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: {{(pid=117852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:12:14.310972 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:12:14.310972 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:12:14.310972 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:12:14.310972 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:12:14.310972 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:12:14.310972 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:12:14.310972 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:12:14.310972 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:12:14.310972 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:12:14.310972 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a805bc0-29bf-4ca0-80b2-e2ee71912d51 could not be found. Jun 16 19:12:14.310972 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:12:14.310972 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:12:14.310972 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:12:14.310972 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:12:14.310972 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:12:14.310972 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:12:14.310972 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:12:14.310972 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:12:14.310972 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:12:14.313427 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:12:14.313427 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 19:12:14.313427 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 19:12:14.313427 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 19:12:14.313427 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 19:12:14.313427 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:12:14.313427 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:12:14.313427 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:12:14.313427 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:12:14.313427 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a805bc0-29bf-4ca0-80b2-e2ee71912d51 could not be found. Jun 16 19:12:14.313427 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:12:14.313427 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:12:14.313427 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:12:14.313427 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:12:14.313427 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:12:14.313427 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:12:14.313427 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:12:14.313427 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:12:14.313427 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a805bc0-29bf-4ca0-80b2-e2ee71912d51 could not be found. Jun 16 19:12:14.313427 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: ERROR nova.api.openstack.wsgi Jun 16 19:12:14.316330 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: DEBUG nova.api.openstack.wsgi [None req-575c1f80-efb7-4f1d-abe7-b063780a1d5d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Returning 404 to user: Instance 7a805bc0-29bf-4ca0-80b2-e2ee71912d51 could not be found. {{(pid=117852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:12:14.316330 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO nova.api.openstack.requestlog [None req-575c1f80-efb7-4f1d-abe7-b063780a1d5d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "DELETE /compute/v2.1/servers/7a805bc0-29bf-4ca0-80b2-e2ee71912d51" status: 404 len: 111 microversion: 2.1 time: 0.029790 Jun 16 19:12:14.316330 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: [pid: 117852|app: 0|req: 587/1155] 10.222.0.70 () {58 vars in 1238 bytes} [Thu Jun 16 19:12:14 2022] DELETE /compute/v2.1/servers/7a805bc0-29bf-4ca0-80b2-e2ee71912d51 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:12:14.319688 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-b8e7757a-f507-494c-b8b7-dc10b43e9a3d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Calling method '>' {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 19:12:14.320296 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.compute.api [None req-b8e7757a-f507-494c-b8b7-dc10b43e9a3d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] [instance: 7a805bc0-29bf-4ca0-80b2-e2ee71912d51] Fetching instance by UUID {{(pid=117850) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 19:12:14.327505 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b8e7757a-f507-494c-b8b7-dc10b43e9a3d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:14.327958 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b8e7757a-f507-494c-b8b7-dc10b43e9a3d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:14.328721 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b8e7757a-f507-494c-b8b7-dc10b43e9a3d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 19:12:14.329158 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG oslo_concurrency.lockutils [None req-b8e7757a-f507-494c-b8b7-dc10b43e9a3d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Lock "1c329222-bcc4-442b-afcb-bc828e5eed9e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 19:12:14.343323 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.wsgi [None req-b8e7757a-f507-494c-b8b7-dc10b43e9a3d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] HTTP exception thrown: Instance 7a805bc0-29bf-4ca0-80b2-e2ee71912d51 could not be found. Jun 16 19:12:14.344845 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-b8e7757a-f507-494c-b8b7-dc10b43e9a3d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Request method failure captured: Jun 16 19:12:14.344845 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: request: GET /compute/v2.1/servers/7a805bc0-29bf-4ca0-80b2-e2ee71912d51 HTTP/1.1 Jun 16 19:12:14.344845 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Accept: application/json Jun 16 19:12:14.344845 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Accept-Encoding: identity Jun 16 19:12:14.344845 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Connection: close Jun 16 19:12:14.344845 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Content-Length: 0 Jun 16 19:12:14.344845 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Content-Type: application/json Jun 16 19:12:14.344845 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Host: 10.222.0.70 Jun 16 19:12:14.344845 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Openstack-System-Scope: None Jun 16 19:12:14.344845 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: User-Agent: python-urllib3/1.26.9 Jun 16 19:12:14.344845 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Auth-Token: gAAAAABiq397T4ON-zQSBMJgTjz79-0rWbCf9bpfcP8v-Jb0yUpscjKugrXoi0b22yw1HJ_i1bTu9MeeX2PCjDS1AXbAoxSR6e2OSDrQ63ej8My_EvvhndYrxtwl3jqGomk9A-ziExtrOqReYSW9IwopSACLPtaotkV-uvvWqsg4A20E92OPpA0 Jun 16 19:12:14.344845 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Domain-Id: None Jun 16 19:12:14.344845 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Domain-Name: None Jun 16 19:12:14.344845 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Identity-Status: Confirmed Jun 16 19:12:14.344845 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Is-Admin-Project: True Jun 16 19:12:14.344845 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Domain-Id: default Jun 16 19:12:14.344845 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Domain-Name: Default Jun 16 19:12:14.344845 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Id: bf39ecb69ea7474d940ad17f8bab4874 Jun 16 19:12:14.344845 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Project-Name: tempest-AttachVolumeNegativeTest-1452215888 Jun 16 19:12:14.344845 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Role: member,reader Jun 16 19:12:14.344845 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Roles: member,reader Jun 16 19:12:14.346604 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/bf39ecb69ea7474d940ad17f8bab4874"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_bf39ecb69ea7474d940ad17f8bab4874", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/bf39ecb69ea7474d940ad17f8bab4874"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/bf39ecb69ea7474d940ad17f8bab4874"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}] Jun 16 19:12:14.346604 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant: tempest-AttachVolumeNegativeTest-1452215888 Jun 16 19:12:14.346604 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant-Id: bf39ecb69ea7474d940ad17f8bab4874 Jun 16 19:12:14.346604 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1452215888 Jun 16 19:12:14.346604 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User: tempest-AttachVolumeNegativeTest-1452215888-project Jun 16 19:12:14.346604 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Domain-Id: default Jun 16 19:12:14.346604 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Domain-Name: Default Jun 16 19:12:14.346604 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Id: 55f5aba8355c436b94508156bca24ab3 Jun 16 19:12:14.346604 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: X-User-Name: tempest-AttachVolumeNegativeTest-1452215888-project Jun 16 19:12:14.346604 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: method: > Jun 16 19:12:14.346604 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: exception: Instance 7a805bc0-29bf-4ca0-80b2-e2ee71912d51 could not be found. Jun 16 19:12:14.346604 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: action_args: {'id': '7a805bc0-29bf-4ca0-80b2-e2ee71912d51'} Jun 16 19:12:14.347576 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: {{(pid=117850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 19:12:14.347576 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:12:14.347576 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 19:12:14.347576 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 19:12:14.347576 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 19:12:14.347576 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 19:12:14.347576 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 19:12:14.347576 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 19:12:14.347576 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 19:12:14.347576 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 19:12:14.347576 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a805bc0-29bf-4ca0-80b2-e2ee71912d51 could not be found. Jun 16 19:12:14.347576 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:12:14.347576 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:12:14.347576 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:12:14.347576 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:12:14.347576 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:12:14.347576 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:12:14.347576 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 19:12:14.347576 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 19:12:14.347576 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 19:12:14.349105 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 19:12:14.349105 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 19:12:14.349105 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 19:12:14.349105 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 19:12:14.349105 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 19:12:14.349105 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 19:12:14.349105 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 19:12:14.349105 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a805bc0-29bf-4ca0-80b2-e2ee71912d51 could not be found. Jun 16 19:12:14.349105 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:12:14.349105 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 19:12:14.349105 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:12:14.349105 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 19:12:14.349105 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 19:12:14.349105 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 19:12:14.349105 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 19:12:14.349105 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 19:12:14.349105 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a805bc0-29bf-4ca0-80b2-e2ee71912d51 could not be found. Jun 16 19:12:14.349105 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: ERROR nova.api.openstack.wsgi Jun 16 19:12:14.350457 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: DEBUG nova.api.openstack.wsgi [None req-b8e7757a-f507-494c-b8b7-dc10b43e9a3d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] Returning 404 to user: Instance 7a805bc0-29bf-4ca0-80b2-e2ee71912d51 could not be found. {{(pid=117850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 19:12:14.350457 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO nova.api.openstack.requestlog [None req-b8e7757a-f507-494c-b8b7-dc10b43e9a3d tempest-AttachVolumeNegativeTest-1452215888 tempest-AttachVolumeNegativeTest-1452215888-project] 10.222.0.70 "GET /compute/v2.1/servers/7a805bc0-29bf-4ca0-80b2-e2ee71912d51" status: 404 len: 111 microversion: 2.1 time: 0.031694 Jun 16 19:12:14.350457 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: [pid: 117850|app: 0|req: 569/1156] 10.222.0.70 () {58 vars in 1235 bytes} [Thu Jun 16 19:12:14 2022] GET /compute/v2.1/servers/7a805bc0-29bf-4ca0-80b2-e2ee71912d51 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 19:14:29.301928 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 19:14:29.302541 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Thu Jun 16 19:14:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 19:14:48.286513 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 19:14:48.287107 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Thu Jun 16 19:14:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 19:14:50.662546 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 19:14:50.663224 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Thu Jun 16 19:14:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 19:14:51.823060 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 19:14:51.823620 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Thu Jun 16 19:14:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 19:16:09.782093 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 19:16:09.782870 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Thu Jun 16 19:16:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 19:16:10.251219 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 19:16:10.251789 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Thu Jun 16 19:16:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 19:17:49.310498 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 19:17:49.311197 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Thu Jun 16 19:17:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 19:18:08.294931 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 19:18:08.295506 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Thu Jun 16 19:18:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 19:18:10.670591 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 19:18:10.671193 dv-cinder-846172-1-iscsi devstack@n-api.service[117852]: Thu Jun 16 19:18:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 19:18:11.830835 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 19:18:11.831393 dv-cinder-846172-1-iscsi devstack@n-api.service[117850]: Thu Jun 16 19:18:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!